Linear algebra is concerned with vector spaces of all dimensions and linear transformations between them, including systems of linear equations, bases, dimensions, subspaces, matrices, determinants, traces, eigenvalues and eigenvectors, diagonalization, Jordan forms, etc. For questions specifically ...

learn more… | top users | synonyms (1)

4
votes
0answers
184 views

What does affine invariance mean in the context of the Newton's method?

The textbook Numerical Solution of Boundary Value Problems for Ordinary Differential Equations (by Ascher, Mattheij, and Russell) states on page 329: [W]e observe that Newton's method is affine ...
4
votes
0answers
132 views

Prob. 10, Sec. 3.2 in Erwine Kreyszig's “Introductory functional analysis with applications”

Here is Prob. 10 in the Problems after Sec. 3.2 in Introductory Functional Analysis With Applications by Erwine Kreyszig: ... Let $T \colon X \to X$ be a bounded linear operator on a complex ...
4
votes
0answers
63 views

Number of solutions of an equation

Fix a vector $x\in\{0,1\}^n$, and let $a$ be a random vector in $\mathbb{Z}^n_q$ for some prime $q$. Consider $y=ax$, and $S=\{x'\mid ax'=y\}$. I want to compute the probability that $\lvert S \...
4
votes
0answers
42 views

Finding proper matrix?

I would like to find a "mechanic" way in order to solve such questions. Find a matrix $A \in \mathbb{R}^{3\times3}$ corresponding to the following: $ A\cdot A=$ \begin{pmatrix} 1 & 0 &2 \\ 0 ...
4
votes
0answers
180 views

How can one prove the existence and uniqueness of solutions to linear differential equations?

It is a theorem (I think) that the equation: $$\mathbf{x}'(t) = A(t)\mathbf{x}(t) + \mathbf{b}(t); \qquad \qquad \mathbf{x}(t_0) = \mathbf{x}_0$$ Has a unique global solution for any matrix $A(t)...
4
votes
0answers
143 views

What do the eigenvalues/vectors of a metric describe?

Given a finite metric space $(X = \{ x_i \}_{i=1}^n,d)$, one can form the matrix $A$ of pairwise distances $a_{ij} = d(x_i, x_j)$. What does the eigenspectrum of this matrix say about the metric $d$? ...
4
votes
0answers
49 views

Rank of a matrix whose all entries have the form $m^k$

The original problem is: Compute the determinant $$\begin{vmatrix} 1^k & 2^k & 3^k & \cdots & n^k \\ 2^k& 3^k & 4^k &\cdots & (n+1)^k \\ 3^k& 4^k &...
4
votes
0answers
77 views

Calculation of an expression ($\max_{U}\min_i \sum_j |U_{ij}|^2 |e_i^j|^2$)

There is an orthonormal basis $\{e_i\}(i=1,\ldots,n)$ in $\mathbb{C}^n$, each of them is represented in form of column vectors $$\begin{pmatrix} e_i^1\\ \vdots\\e_i^n\end{pmatrix}.$$ My purpose is to ...
4
votes
0answers
76 views

Wedge product and its dual

I am learning about differential forms and exterior algebra, and I am trying to get more familiar with the wedge product of vectors. A differential form is an element of $\left( \bigwedge^k (A)\right)^...
4
votes
0answers
138 views

Eigenvalues of Overlapping block diagonal matrices

I look for eigenvalues of general overlapping block diagonal matrices. e.g. $$\left[ \begin{matrix} 1 & 4 & 0 & 0 & 0 & 0\\ 4 & 2 & 3 & 2 & 0 & 0\\ 0 & 3 &...
4
votes
0answers
183 views

Coefficients of spherical solution to Laplace's equation with difficult Robin boundary conditions

I'm trying to solve Laplace's equation in an (axisymmetric) external spherical domain. The controlling equation is: $$\nabla^2 f = 0$$ $f$ must dissappear at infinity, and at the surface of the ...
4
votes
0answers
133 views

Invariance of determinant of metric tensor

Given any 2-tensor on a Riemannian manifold $M$ equipped with metric $g,$ we have a coordinate-free definition of its trace: $$\operatorname{trace}(T)=g^{ij}T_{ij}= T_i^i.$$ In particular, we have $$...
4
votes
0answers
102 views

Unexpected applications of row rank = column rank

The fact that the row rank of a matrix is the same as the column rank is quite surprising (to me atleast, hopefully to you too!). I am looking for unexpected applications of this fundamental fact, ...
4
votes
0answers
107 views

Tools to bound the singular values of a finite sum of random matrices from below?

Matrix Chernoff bounds (see also this arXiv paper) are usually used to give upper bounds on the largest eigenvalue of a finite sum of random matrices. Sometimes it can also be used to give a lower ...
4
votes
0answers
150 views

How does pointwise multiplication of two matrices affect their eigenvectors?

More specifically, suppose I have a known matrix $X\in\mathbb{R}^{d\times n}$ and an unkown vector $\alpha \in \mathbb{R}^n$. What can be said about the eigenvectors of $\alpha\alpha^T \odot X^T X$ ...
4
votes
0answers
161 views

If $n$ is even, every skew-symmetric $n\times n$ matrix $A$ can be factored as $A=SBS^T$

If $n$ is even, every skew-symmetric $n\times n$ matrix $A$ can be factored as $A=SBS^T$ where $S$ is a invertible matrix and $B$ has the form $B = \left( \begin{array}{ccc} 0 & a_1 & 0 & ...
4
votes
0answers
61 views

Seeking diagonal $D$ such that $AD^2B$ is positive definite (A and B are symmetric and p.d.)

Let A,B be two real symmetric, non-commuting positive definite matrices. Then the product AB is not positive definite (in the sense that ${\bf x}^TAB{\bf x}$ may be anything). I'm trying to find ...
4
votes
0answers
367 views

Optimized way to compute L1 distance matrix

I'm computing distances between two groups of multi-dimensional points giving a matrix of distances pairwise between points. For the L2 (euclidean) distance I can use optimized matrix multiplication ...
4
votes
0answers
92 views

Convexity of $S=\left\{ \frac{\underline{x}^HA\underline{x}}{\underline{x}^H\underline{x}} , \underline{x} \in \mathbb C ^{n}\right\}$

i've to prove that the following set is convex: Let $A \in \mathbb{C}^{n \times n}$ $$S=\left\{ \frac{\underline{x}^HA\underline{x}}{\underline{x}^H\underline{x}} , \underline{x} \in \mathbb C ^n\...
4
votes
0answers
78 views

finding the algebraic dimension of $\ell^p$ spaces

I want to know "how we can find the algebraic dimension(the cardinal number of the Hamel basis) for $\ell^p$ spaces." What can we say about $\ell^p(I)$, where $I$ is an infinite set?\ Moreover, for ...
4
votes
0answers
36 views

Reference for Generalized Eigenvectors

I am looking for references on generalized eigenvectors and Jordan matrix representation. I would like a brief but complete introduction of this concepts with a nice treatment of the most important ...
4
votes
0answers
218 views

“Rank-K Correction” of a matrix and significance?

Today my studies led me to read about the matrix inversion lemma, which Wikipedia introduces as follows: In mathematics (specifically linear algebra), the Woodbury matrix identity, named after Max ...
4
votes
0answers
102 views

Consistency of different ways to define the tensor product

It seems my trouble with understanding tensors stems from the following statement: More specifically, the statement: Namely, given $B: V \times W \to U$ and $\xi: U \to \mathbb{R}$, $\xi ...
4
votes
0answers
71 views

co and contravariant vectors, their difference and properties

Very often when talking about covectors, co- and contravariant stuff, it's mentioned that there is no difference in "normal" linear algebra. That the difference only comes "when dealing with curved ...
4
votes
0answers
235 views

Linear Algebra, Eigenvalues and Eigenvectors Exercise

I have a question from an exercise. I am given a vector space over the field $\mathbb{R}^{3}$ with 2 dimensions and I am asked to find a basis of eigenvectors. I found the eigenvalues but I have ...
4
votes
0answers
76 views

Bayesian linear regression cost function

I am studying classification using linear regression . Now, I want to map it in Bayesian regression. Let talk about binary classification using linear regression again. Assume that I have a set $X=${...
4
votes
0answers
59 views

Blocking set for cosets of codimension $2$

In this paper following theorem is proved: If $V$ is vector space of dimension $n$ over a finite field $F$ of $q$ elements then any subset of $V$ which meets every hyperplane of $V$ contains at least ...
4
votes
0answers
85 views

Does this characterize the operator norm of the inverse?

Let $A$ be an invertible operator (bounded with bounded inverse). Then $$\frac{1}{\|A^{-1}\|} = \inf\left\{\frac{\|Av\|}{\|v\|} : v \neq 0\right\}$$ I believe I have a proof as follows, but I just ...
4
votes
0answers
47 views

Determinant of triangular matrix except for one column (atomic/Gauss/Frobenius)

Is there some "smart" way to calculate determinants that look like this? $\begin{vmatrix}-1&a_{1,2}&a_{1,3}&a_{1,4}&\cdots&a_{1,m-1}&a_{1,m} \\-1&a_{2,2}&a_{2,3}&...
4
votes
0answers
119 views

A problem on 0-1 matrices.

Given a 0-1 matrix $A$, is there an efficient way to find all 0-1 vectors $x$ such that $Ax = v$ where the entries of $v$ belong to a set $\{a,b\} \subseteq \mathbb{Z}$ of size $2$? Note that $v$ is ...
4
votes
0answers
147 views

Product of Elements in SU(2)

Let $$ V := \frac{x_4+i\vec{x}\cdot{\vec{\sigma}}}{\left|x\right|}$$ where $\left(x_1,x_2,x_3,x_4\right)\in\mathbb{R}^4$, $|x|$ is the Euclidean norm, and $\sigma^j$ are the Pauli matrices. Let $\...
4
votes
0answers
49 views

Are these vectors a base of the Subspace?

$a=(1,2,3,0)$ $b=(0,3,2,4)$ $a$ and $b$ form the subspace $U$ is the base $B(a,b)$ a base of $U$? My guess is yes, because they are linearly indpendent?
4
votes
0answers
78 views

Does the cross section of $[-1,1]^n$ on a $k$-dimensional subspace always contains a rotated image of $[-1,1]^k$?

This question is inspired by a recent bounty question, but the two questions are different and solving this one, I believe, will not lead to an answer of that bounty question. Suppose $n>k\ge1$ ...
4
votes
0answers
130 views

Spectral decomposition of $TT^*$

On $l_{2}$ let $T$ be given by $Te_{n}=\frac{e_{n+1}}{n+1}$ where $(e_{n})_{n\ge1}$ is the canonical orthonormal basis. Find the spectral decomposition of $TT^*$. I find that $T^*(e_{n})=\frac{e_{n-...
4
votes
0answers
54 views

Particular determinant made of powers of algebraic numbers is nonzero?

Let $P$ be a degree-two polynomial, with roots $\alpha,\beta$. Is there a simple condition on $P$ (or on $\alpha,\beta$), equivalent to the following : $$ (*)\alpha^i\beta^j-\alpha^j\beta^i+\beta^i-\...
4
votes
0answers
76 views

Symmetric non-degenerate bilinear forms over $\mathbb{Z}$ and $\mathbb{Q}$

Consider the four non-degenerate symmetric bilinear forms over $\mathbb{Q}$ given be the matrices $\bigl(\begin{smallmatrix} 1&0\\ 0&1 \end{smallmatrix} \bigr)$,$\bigl(\begin{smallmatrix} 1&...
4
votes
0answers
68 views

Conditions of a Monotonic Process?

$f$ is the output of a discrete time process described by $f(k)=\sum_{i=1}^{k-1}w_{ki}f(i)$ where $f(1)\geq0$ is a known initial condition and $w_{ki}\geq0$ are weights of previous states on the ...
4
votes
0answers
134 views

Understanding a sentence in a paper.

I am trying to read this paper. At page $34$, the authors define a symplectic form $\omega$ on some $\mathbb{C}$-vector space $V\oplus W^*$ (I don't want to go too much into the details here, because ...
4
votes
0answers
284 views

Cross Product - Moments :: Dynamics

Some background: I am self studying dynamics and I have encountered a fundamental problem with either my understanding of linear algebra, or I am just plain dumb. So, I print screened the page of the ...
4
votes
0answers
104 views

Non Existence of matrices $A,B\in M_n(\mathbb{R})$ such that $(I-(AB-BA))^n=0$

Question is to Prove: Non Existence of matrices $A,B\in M_n(\mathbb{R})$ such that $(I-(AB-BA))^n=0$. This question has already been asked already but then i am asking for clarification of another ...
4
votes
0answers
83 views

Identifying the joint distribution from some values of $t \cdot X$

Suppose that $S$ is a subset of $\mathbb{R}^n$ and $X, Y$ are $\mathbb{R}^n$ valued RVs. We already know that $X$ and $Y$ are equidistributed iff $t \cdot X=^d t\cdot Y$ for all $t \in \mathbb{R}^n$. ...
4
votes
0answers
92 views

Smallest value that a certain variable can take in a system of equations.

Consider the solutions $(x,y,z,u)$ of the system of equations: $$\begin{cases} x+y=3(z+u)\\ x+z=4(y+u)\\ x+u=5(y+z)\\ \end{cases}$$ where $x,y,z \text{ and } u$ are positive integers. What is ...
4
votes
0answers
102 views

Linear dimension of banach spaces

Let $X$ be some vector space (over $\mathbb{C}$). Note that if $X$ is of finite dimension we can identify $X$ with $\mathbb{C}^n$ for some natural $n$ and endow it with a norm $||x||=|x_1|+...+|x_n|$. ...
4
votes
0answers
90 views

Show $r(F)=r(F^2)$ implies $Im(F) \cap Ker(F)=\{0\}$

I wonder if I've made some mistakes in the proof of the following or if there is some simpler solution. Problem: Let $V$ be a finite dimensional vectorspace and $F:V \rightarrow V$ a linear operator. ...
4
votes
0answers
228 views

The close form expression of a Pfaffian

Recall Schur's Pfaffian identity: $$ \mathrm{Pf}\left(\frac{x_j-x_i}{x_j+x_i}\right)_{1\le i,j\le 2n} = \prod_{1\le i<j \le 2n}\frac{x_j-x_i}{x_j+x_i}. $$ Here $x_1,x_2\cdots x_{2n}$ are $2n$ ...
4
votes
0answers
1k views

How can I solve system of linear equations over finite fields in WolframAlpha?

Is it possible to solve system of linear equations over finite fields using Wolfram Alpha? If yes, how can I do that? Let us take a system $x+y+z=0$, $2x+y+2z=0$, $x+3y+z=0$. If I want to solve this ...
4
votes
0answers
95 views

The determinant of a special matrix

Recently, I encounter the problem of calculating the determinant of the following matrix $$\left(\begin{array}{cccc} \sin(\theta_1) & \sin(\theta_1 + \delta_1) & \cdots & \sin(\theta_1 + (...
4
votes
0answers
65 views

Decomposability in the tensor product sense of functions of two variables

Let $S$ and $T$ be "nice" metric spaces, e.g. complete normed fields like $\Bbb R$, $\Bbb C$ or $\Bbb Q_p$. Let $F$ be a function $$ F:S\times T\longrightarrow K $$ where $K$ is a topological field ...
4
votes
0answers
1k views

Proof of rank nullity theorem

I read about rank nullity theorem (with proof) but then tried to prove it in different way. Please can you read my proof and tell me if it is correct? The rank nullity theorem: If $T:V\to W$ is a ...
4
votes
0answers
560 views

Upper bound for smallest eigenvalue

I am looking for a (simple) upper bound for the smallest eigenvalue of an $n\times n$ matrix, involving determinant or trace or something else that can be easily computed. I've got an upper bound from ...