Control theory is an interdisciplinary branch of engineering and mathematics that deals with the behavior of dynamical systems with inputs. The external input of a system is called the reference. When one or more output variables of a system need to follow a certain reference over time, a controller ...

learn more… | top users | synonyms

24
votes
5answers
4k views

What is the mathematical foundation of Control Theory?

There is a question which I'm wondering again and again in recent months. I have taken courses like Elementary Differential Equations, Signals and Systems, Linear Control Systems, General Theory of ...
19
votes
5answers
15k views

Why use a Kalman filter instead of keeping a running average

I've been trying to understand Kalman filters. Here are some examples that have helped me so far: http://bilgin.esme.org/BitsBytes/KalmanFilterforDummies.aspx http://www.scipy.org/Cookbook/...
14
votes
0answers
148 views

Level sets of solution to Nonlinear PDE

I work on Stochastic Control theory and BSDE's for my research. In my research, I characterized the set I am interested in as the level set of a function which is a viscosity solution to nonlinear PDE ...
11
votes
3answers
1k views

Difference between Bellman and Pontryagin dynamic optimization?

Can someone please explain the difference between dynamic optimization via the Bellman equation and dynamic optimization via Pontryagin's maximization principle? Thanks
11
votes
2answers
671 views

Lyapunov stability question (Arnold's trivium)

V.I. Arnold put the following question in his Mathematical trivium: Can an asymptotically stable equilibrium position become unstable in the Lyapunov sense under linearization? It puzzled me for a ...
10
votes
3answers
3k views

If matrices $A$ and $B$ commute, $A$ with distinct eigenvalues, then $B$ is a polynomial in $A$

If $A\in M_{n}$ has $n$ distinct eigenvalues and if $A$ commutes with a given matrix $B\in M_{n}$, how can I show that $B$ is a polynomial in $A$ of degree at most $n-1$? I think first I need to show ...
9
votes
6answers
3k views

Control / Feedback Theory

I am more interested in the engineering perspective of this topic, but I realize that fundamentally this is a very interesting mathematical topic as well. Also, at an introductory level they would be ...
9
votes
2answers
170 views

Solutions of $XA=XAX$.

All matrices are real and $n \times n$. The matrix $A$ is given. I am interested in solving $XA=XAX$. In particular, I would like some characterization of matrices that satisfy this equation. For ...
8
votes
2answers
174 views

$L^2$ Bounds for Markov Chains.

Consider a non-negative, square stochastic $n \times n$ matrix $P$ (rows sum to one, $P$ is ergodic). We are interested in characterizing the set of $n \times n$ invertible matrices $A$ such that we ...
7
votes
2answers
536 views

How can I, as a future mathematician, contribute most to Smart Grid research?

After I've finished my Master's degree in mathematics, I too want to use my powers for good. One endeavour I consider good is the pursuit of the design and implementation of a Smart Grid which will, ...
7
votes
2answers
84 views

I'm trying to calculate $e^{At}$. Where do I go wrong?

Let $$A=\begin{bmatrix}0 & 1 & 0 & 0 \\ -1 & 0 & 0 & 0 \\ 0 & 0 & 0 & 1 \\ 0 & 0 & -4 & 0\end{bmatrix}$$ I want to determine $e^{At}$. I tried it using ...
7
votes
2answers
234 views

Rigorous mathematical treatments of engineering topics

I started out as an engineering student and got interested in mathematics. So after some point (Rigorous analysis and linear algebra, some real analysis, basic measure theory and topology etc.) I ...
7
votes
1answer
286 views

Checking the stability of an equilibrium point

I have the linearization of a non-linear system about an equilibrium point as follows $$ \dot x = (-A+M)x, $$ where $x\in\mathbb{R}^3$, $A$ is a positive definite matrix and $M$ has its eigenvalues ...
6
votes
1answer
93 views

Linearization of $ m \dfrac{dy^2}{dt^2} = u(t) - C_d \left( \dfrac{dy}{dt} \right)^2-mg $

$$ m \frac{dy^2}{dt^2} = u(t) - C_d \left( \frac{dy}{dt} \right)^2-mg $$ where $$\begin{align*} y(t)&=\text{missile altitude}\\ u(t)&= \text{force}\\ m&= \text{mass}\\ C_d&= \text{...
5
votes
2answers
1k views

The nature of eigenvectors of a given eigenvalue

I am working on a problem where I have an ($n \times n $) matrix A and an eigenvalue of A, $\lambda$, where $\lambda$ has geometric multiplicity 1. The right and left eigenvectors of A corresponding ...
5
votes
1answer
2k views

Smith normal form of a polynomial matrix.

I have the following matrix: $P(s) :=$ \begin{bmatrix} s^2 & s-1 \\ s & s^2 \end{bmatrix} How does one compute the Smith normal form of this matrix? I can't quite grasp the algorithm.
5
votes
2answers
866 views

PID controller convergence

Is there any material anywhere on convergence of PID controllers? Ie, if we formalize the "plant process" in some way, like $y_{t+1} = f(x_t,y_t)$ (in other words, the process value at a given time ...
5
votes
1answer
73 views

Minimum infinity norm control problem

I am having trouble understanding Example 2 of section 5.9 of Luenberger's Optimization by Vector Space Methods. The problem is to select a current $u(t)$ on $[0,1]$ to drive a motor governed by $$ \...
5
votes
1answer
63 views

Reference request: “initial” PDE control

I'm somewhat familiar with the ideas of boundary and internal (source) control for PDE (in particular, for wave equations) but am wondering if the following type of problem is classified/studied; if ...
5
votes
0answers
116 views

Two definitions of uniformly observable, are they equivalent?

When I do my research, I found that there are two definitions of uniformly observable, I can't help thinking are they equivalent? These two definitions are listed as follows. For a linear stochastic ...
5
votes
0answers
127 views

Eigenvalues of a matrix written in controllable canonical form

Let the following equation represent a stable (marginally) dynamical system in discrete time domain \begin{equation} \mathbf{x}_{k+1} = \mathbf{A}\mathbf{x}_k + \mathbf{B}\mathbf{u}_k \end{equation} ...
4
votes
1answer
8k views

Kalman Filter to determine position and attitude from 6DOF IMU (accelerometer + gyroscope)

I'm going to describe the problem I'm trying to solve and walk through what I understand so far about the Kalman Filter. I have an IMU which gives me the following measurements every time interval t: ...
4
votes
3answers
198 views

If $\|u\|^2 = c^2$, then $\|\dot x\|^2 \to a $ for $\ddot x = -\dot x + u(t)$?

I am dealing with the next simple equation $$ \ddot x = -\dot x + u(t), $$ where $u, x\in\mathbb{R}^m$, with $m \geq 1$, and I am wondering if for $\|u\|^2 = c^2 > 0$ then $\|\dot x\|^2\to a$, ...
4
votes
2answers
120 views

How to use mathematically the I and D of a PID controller

I am trying to mathmatically understand how the $P$, $I$, and $D$ parameters work on a system, quite having a hard time doing so. I've only been able to show that the Steady State Error (SSE) never ...
4
votes
2answers
114 views

Show that all the roots of $\frac{dx}{dt}=A(t)x$ are bounded in $[t_0, \infty)$.

For real system of equations$$\frac{dx}{dt}=A(t)x,(1)$$ where $A(t) \in C[t_0, +\infty)$. Prove that if $\int_{t_0}^{\infty} \|A(t_1)+A^T(t_1)\|< +\infty$ then all the roots of (1) are bounded in $...
4
votes
2answers
155 views

Prove that $x \equiv 0$ of $\dot{x}(t)=a(t)x$ is Uniformly Asymptotically Stable

I have a problem: Consider the scalar equation: $$\dot{x}(t)=a(t)x \tag{I}$$ where $a(t) \in C(\mathbb{R}^+)$. Prove that $x \equiv 0$ of $(I)$ is Uniformly Asymptotically Stable iff $$\...
4
votes
2answers
291 views

Show that System $(I)$ is stable iff $X(t)$ is bounded.

I have a theorem: For a linear homogeneous system: $$\dfrac{dx}{dt}=A(t)x \tag{I}$$ Where $A(t)=(a_{ij}(t))_{n \times n} \in C(\mathbb{R}^+,\mathbb{R}^{n \times n})$ Suppose that $X(t)$ be the ...
4
votes
1answer
56 views

How would I solve the following equation, which is similar to an algebraic Riccati equation or a nonlinear sylvester equation?

I have the following matrix equation that I would like to solve for $X$: $0 = AX + XB + XCX + D$ In general, $X$ will be rectangular, with $(m\times n)$ dimensions. So if I write the equation out ...
4
votes
1answer
351 views

Difference between Variation of Calculus problems and Control Theory problems?

Variation of Calculus seems to have problems without the control with variables such as state and time. Then again Control Theory problems seems to have problems with one extra variable that is ...
4
votes
1answer
434 views

Solving for specific entries in a Lyapunov Equation

Let $A$ be a $2n\times 2n$ real matrix with the following structure \begin{equation} A = \left(\begin{matrix} 0 & -I \\ K & S \end{matrix}\right) \end{equation} with all sub-matrices of size $...
4
votes
1answer
2k views

Root Locus Diagrams - “Breakaway Point”

Say that we have a root locus diagram with n poles and m zeroes. And we determine that the root locus on the real axis lies between two of these poles and breaks away from the real axis and tends to ...
4
votes
1answer
107 views

Estimating the input to a system from a system state

[ Cross-posted to: http://dsp.stackexchange.com/questions/3098/estimating-the-input-to-a-system-from-a-system-state-using-ekf ] I have a system for which I have obtained a non-linear time-varying ...
4
votes
0answers
47 views

No local optima in quantum control?

Given a manifold $M$ and a set of smooth functions of one real variable $\mathcal{A}$ and a 'control system' type first order differential equation: $\frac{d x(t)}{dt} = F(x,u)$ one can consider the ...
4
votes
0answers
128 views

Why no Forward Dynamic Programming in stochastic case?

Dynamic programming usually works "backward" - start from the end, and arrive at the start. This works both when there is and when there isn't uncertainty in the problem (e.g. some noise in the state)....
4
votes
0answers
52 views

Stochastic control with stopping times

Given a wealth process that evolves as $$d w_t = r w_t dt + \theta_t ( \sigma dW_t + (\mu-r) dt) - c_t dt.$$ and smooth functions $u,F: [0, +\infty) \rightarrow \mathbb{R}$, how can we optimise the ...
4
votes
0answers
68 views

Conditions of a Monotonic Process?

$f$ is the output of a discrete time process described by $f(k)=\sum_{i=1}^{k-1}w_{ki}f(i)$ where $f(1)\geq0$ is a known initial condition and $w_{ki}\geq0$ are weights of previous states on the ...
4
votes
0answers
183 views

Prove that all the solutions of (2): $\frac{dy}{dt}=A(t)y+f(t)$ are bounded in $ \left[t_0,+\infty \right )$

I have a problem: Assume that system (1): $$\dfrac{dx}{dt}=A(t)x$$ is stable, where $A(t) \in C\left [t_0,+\infty \right )$, when $t \to \infty$ and $$\begin{cases} & \mathrm{ } \...
3
votes
3answers
2k views

Poles and Zeros of Linear Systems

This period I follow a course in System and Control Theory. This is all about linear systems $$\frac{dx}{dt}= Ax + Bu $$ $$y = Cx + Du $$ where A,B,C,D are matrices, and x, u and y are vectors. ...
3
votes
4answers
216 views

Stability theory: Every solution of the scalar equation: $\ddot{x}+\left [a+b(t) \right ]x=0$ is bounded in $\left [t_0, +\infty \right )$.

EDITED Prove that: If $a>0$ and $$\int_{t_0}^{\infty} |b(t_1)|\mathrm{d}t_1<+\infty$$ then every solution of the scalar equation: $$\ddot{x}+\left [a+b(t) \right ]x=0$$ is bounded in $\left [...
3
votes
3answers
335 views

An introduction to control systems

I am looking for an introduction on control systems in the context of engineering, but treated from a more mathematical point of view. Does anybody have a good reference?
3
votes
4answers
100 views

Please someone tell me the name of this algebra trick or where I can learn how to do it..

Okay so my algebra knowledge is pretty guff.. I am taking a control systems class and pretty much all the questions I am expected to revise, are about doing this algebraic manipulation and I don't ...
3
votes
1answer
754 views

Existence of global solution of Riccati equation

Consider a Riccati differential equation $$ \dot P + A(t)^{T}P + PA(t) -PB(t)R(t)B(t)^{T}P + Q(t) = 0,\;\;\; P(t_0) = P_0 = P_0^{T} \geqslant 0 $$ where $Q(t) = Q(t)^{T} \geqslant 0$, $R(t) = R(t)^{...
3
votes
3answers
51 views

Relation between controllability and stabilization of a system

Suppose i have a control system which is described as: $$ \left\{ \begin{array}{c} \dot{x}(t)=Ax(t)+Bu(t)\\ y(t)=Cx(t)+Du(t) \end{array} \right. $$ and i know it is controllable. I use a state ...
3
votes
1answer
82 views

(Possible) application of Sarason interpolation theorem

This question is related to the following Wikipedia article on Nevanlinna–Pick interpolation. At the end it has been written as Pick–Nevanlinna interpolation was introduced into robust control by ...
3
votes
2answers
124 views

Reference for LPV controls

I am looking for a good mathematical introduction to LPV (Linear Parameter Varying) methods in control theory. I would like it to be more on the mathematical side of things, instead of something aimed ...
3
votes
3answers
97 views

showing any controllable system can be put in 'controller' form.

I am looking at the proof of the following theorem: Let $\dot{x} =Ax + Bu$ be a controllable single input system, where $\Delta_A:= \det(\lambda I -A) = \lambda^n + a_1\lambda^{n-1} + \ldots + a_{n-1}\...
3
votes
2answers
2k views

Solution of a Sylvester equation?

I'd like to solve $AX -BX + XC = D$, for the matrix $X$, where all matrices have real entries and $X$ is a rectangular matrix, while $B$ and $C$ are symmetric matrices and $A$ is formed by an outer ...
3
votes
1answer
377 views

How can I efficiently sketch a Nyquist diagram?

I have the following transfer function: $$P(s) = \frac{3}{(s-1)(s+2)(s+3)}, s= j\omega$$ I got the starting and endpoints: $$\omega_0 = -\frac{1}{2}, \omega_\infty = 0$$ When I split the ...
3
votes
2answers
1k views

Derivation of the Riccati Differential Equation

I am attempting to derive the Riccati Equation for linear-quadratic control. The original equation is: $-\partial V/\partial t = \min_{u(t)} \{x^TQx + u^TRu + \partial V^T/\partial x(Ax + Bu) \}$ $x ...
3
votes
2answers
80 views

When is a system called linear?

In real time systems / control engineering we have to solve exercises like this: Check if the following systems are linear: 1) $0.2\ddot{x}(t) - (t^2 + 2t -1) x(t) = 3 w(t)$ 2) $\ddot{x}(...