Questions on the various algorithms used in linear algebra computations (matrix computations).

learn more… | top users | synonyms

0
votes
0answers
27 views

Is $ \| \sum_{i \in [k]} \otimes^3 v_i - T \|_F^2 + \theta \| \sum_{i \in [k]} \otimes^3 v_i \|_F^2$ convex?

I am trying to find the minima of the following equation with respect to $v_i$, $i \in [k]$, to solve an optimization problem but I can't manage to make (stochastic or not stochastic, neither of them) ...
0
votes
0answers
49 views

Prove Norm Theorems

I have the following as given: Let $A \in C^{m\times m}$. Then: 1) $$\lVert A\rVert_1 =\sup_{v\in C^m \setminus\{0\} }{\lVert A_v\rVert_1 \over \lVert v\rVert_1} = \max_{j} \sum_i |a_{ij}|$$ How can ...
0
votes
0answers
16 views

Minimising two interdependent equations with least squares regression.

Originally, I had a set of points in three dimensional space that I was fitting using linear regression. So my model is $$Y = \alpha A+ \beta B$$ where $Y = \{y_i\}$ is the dependent variable, and $...
0
votes
0answers
12 views

matrix optimization problem techniques

I'm looking for some resources on learning techniques commonly used in matrix optimization. For example, minimization of the Frobenius/nuclear/weighted norm of a function of a matrix subject to ...
0
votes
0answers
55 views

Beginner Linear Algebra 1 equation with 3 variables

I do not understand what to put into the remaining values. I tried to solve for the y and z like I did for the x, but the system is telling me that is incorrect. Some help would be appreciated
0
votes
0answers
25 views

Computing a new inverse given information from an earlier inverse:

Suppose I have linearly independent set of vectors $v_1 ... v_k \in \mathbb{R}^{k}$. I can let $B = [v_1 ... v_k]$ and by applying Gaussian elimination on the matrix $$ [ B \ I_k] $$ I end up ...
0
votes
0answers
46 views

Hilbert Matrix, Gaussian Elimination with varying pivot strategies, and computation error.

I'm doing a project for my Numerical Analysis class about computational error related to Gaussian elimination, gaussian elimination with partial pivoting, and gaussian elimination with scaled partial ...
0
votes
0answers
23 views

Matrix approximation

How to solve numerically for non-negative full-rank matrices $P$ and $E$ with the following constraints? $Y$ is a known non-negative matrix with $G$ rows and $N$ columns, $G > N$ 1) $PP^TE^T=PY^...
0
votes
0answers
28 views

Cholesky update of $A'A+\gamma I$

Let $A$ be such that $A'A$ is positive definite and admits the Cholesky factorisation $$ A'A = LL' $$ Let us append a column-vector $c$ in $A$ and define $$\bar{A}=\begin{bmatrix}A & c\end{bmatrix}...
0
votes
0answers
77 views

Sum of squares of eigenvalues

Let $\Lambda(A)$ be the sequence of eigenvalues including repeated eigenvalues, if there exist. Show that $$\inf_{X\mbox{ not singular }} \lVert X^{-1}AX\rVert_F^2=\sum_{\lambda\in \Lambda(A)} |\...
0
votes
0answers
53 views

LU decomposition with pivot

I'm trying to LU decompose, with pivoting, the following matrix ($A=(a_{ij})$): A = [2 1 2; 1 0 3; 4 -3 -1]; % matlab I cannot make out from my literature (...
0
votes
0answers
32 views

Inverted pendelum Matrix numerical derivative

Here I've written a dynamic function as : ...
0
votes
0answers
42 views

Way to verify a least-squares solution without actually solving for $x$ and $y$?

I just found the least squares solution of the system $\mathbf{x}A = \mathbf{b} = \begin{pmatrix} x & y \end{pmatrix}\begin{pmatrix} 3 & 2 & 1 \\ 2 & 3 & 2\end{pmatrix} = \begin{...
0
votes
0answers
47 views

roots of Padé approximating polynomials to the exponential function

I need to obtain (numerically) the roots of the denominator in the Padé approximation to the exponential function $e^{-x}$, in Python. I can calculate its coefficients in closed form (see below). But ...
0
votes
0answers
33 views

Find a symmetric matrix of minimal Frobenius norm

Let $A\in \mathbb{R}^{n\times n}$ be a symmetric matrix, And let $$x\in \mathbb{R}^n$$ be such that $\lVert Ax-b\rVert_2 = \min_{z\in \mathbb{R}^n} \lVert Az-b\rVert_2$. Show how to calculate a ...
0
votes
0answers
28 views

Handling large exponents in a matrix

I have four quantities stemming from a 4th order differential equation. I can represent these as a vector which is a product of a 4X4 matrix $$ M=\left\{v,\frac{\partial v}{\partial x},\frac{\partial ...
0
votes
0answers
19 views

Cutting an Orthonormal Basis

I have constructed an orthonormal basis $\{\mathbf{q_1},\dots,\mathbf{q_n}\}$ for a Krylov set $\mathcal{S}_n(A,\mathbf{x})= \text{span}\{\mathbf{x},A\mathbf{x},\dots,A^{n-1}\mathbf{x}\}$ with $\...
0
votes
0answers
25 views

Relation of the upper triangular factor and the original matrix

Suppose $$PA = LU$$ is the LU factorization(exact) of the square real matrix A, L is the unit lower triangular matrix. Is there a way to determine the relation between the norm of $U$ and the norm ...
0
votes
0answers
30 views

Why does the Lanczos algorithm make an orthonormal basis for the Krylov subspace?

Starting with a $v_0$= $b_0$=0 and a symmetric positive definite matrix A. Why does the following algorithm forms an orthonormal basis span{$v_1$,$v_2$,...,$v_n$} for $K_n$(A,$v_1$)? for k=1,...,n-1 ...
0
votes
0answers
64 views

Damped Iteration

For splitting $A = M-P$ a damped iteration with damping factor $\gamma <1$ and scalar $\omega$ is $$x^{k+1} = x^{k} +\gamma M^{-1}r^{k}$$ where $$r^{k} = b-Ax^{k}$$ $$M =\frac{1}{\omega }I $$ $$P = ...
0
votes
0answers
25 views

Preconditioning for Jacobi Method without effect

Show that the following scaling doesn't affect the spectral radius of the Jacobi method iteration matrix $T_{J} = -D^{-1}(L+U)$. $\tilde A=D^{-1 /2}AD^{-1 /2}$, where $D = \operatorname{diag}(a_{11},\...
0
votes
0answers
5 views

how to calculate spectrum of a large collumn stochastic matrix

Okay, I have a collumn stochastic matrix of order $280\times 280$, the entries are given in an url in some webpage in row format. I need to find all the eigen values and eigen vector corresponding to ...
0
votes
0answers
44 views

what's the difference between Eisenstat trick and an implicit preconditioner?

Assume ${A}$ is Hermitian positive definite and $\hat A$=$D^{-1/2}$$A$$D^{-1/2}$ is to obtain a symmetric variant. and $M$=($L_{A}$+$D$)$D^{-1}$($D$+$U_{A}$) where $D$ is a suitable diagonal matrix ...
0
votes
0answers
28 views

Square-root of a matrix which arise from truncating a matrix which has a square-root

I have this covariance matrix $A$ which has a symmetric Toeplitz structure. \begin{equation} A = \left[ \begin{array}{cccccccc} c_0 & c_1 & c_2 & \cdots & c_{n-1} & c_{n} \\ c_1 &...
0
votes
0answers
21 views

Permutation of the posson equation

I have the poisson matrix A, I want to reduce it to the following block matrix: $$ A=\begin{bmatrix} A_{11} & A{12} \\ A_{21} & A_{22} \end{bmatrix} $$, where $A_{11}$ and $A_{22}$ are ...
0
votes
0answers
14 views

Inverse power method - how to decide which $\alpha$ to be used?

Inverse power method - how to decide which $\alpha$ to be used ? I've learnt who inverse power method run, but I don't know how to choose the $\alpha$ $y=(A-\alpha I)^{-1}u_k $ the $\alpha$ here
0
votes
0answers
18 views

Prove $\left \| f-L_{k}^{s}f \right \|_{2} = min_{q \epsilon V_{k} }\left \| f-q \right \|_{2} $

Let q be arbitrary and consider the quadratic function of t defined by: $\phi (t)=\left \| f-L_{n}^{s}f+tq \right \|_{2}^{2}$ Note: $L_{k}^{s}f = \sum_{i=1}^{k}(f,p^{i})p^{i}$ for $i = 1,...,k$ ...
0
votes
0answers
33 views

How to compute the Jacobi matrix (tridiagonal matrix) of a polynomial with a recurrence relationship?

I am looking at Trefethen & Bau Exercise 37.1: I have two normalizations of the Legendre polynomials with corresponding recurrence relations: (1) $P_n(1)=1$ which follows $P_n(x) = \frac{2n-1}{n} ...
0
votes
0answers
27 views

SVM optimisation problem, finding w

I am finding it difficult to find the value for vector w (weight) for the optimization problem which is: $\min \{ (1/2) * w^T * w : y(i) * w^T * x(i) > 0, \ i = 1,\dots,m\}.$ Can someone ...
0
votes
0answers
13 views

Let a and $a_1,…,a_m$ be given vectors i n $\mathbb R^n$ .

Show that two statement are equivalent. (a) For all x ≥ 0 , we have $a'x≤ max a'_i􀂂x.$ (b) There exist nonnegative coefficients $b_i$ that sum to 1 and such that $a \le \sum_{i=1}^m b_i a_i $ can ...
0
votes
0answers
21 views

number of iterations for the generalized conjugate residuals method?

I have the matrix $n \times n $ defined as: $A=\begin{bmatrix} 0 & 1 & 0 & \dots& 0 \\ 0 & 0 & 1 & \dots &0 \\ \dots &\dots ...
0
votes
0answers
23 views

Generalized conjugate residuals method applied to a block matrix

I have the diagonal block matrix A with $2 \times 2$ k-blocks given by : $D_k=\begin{bmatrix} 1 & k\\ 0 & 1 \end{bmatrix} $. I have to show that the generalized ...
0
votes
0answers
21 views

Conjugate gradient method and rietz values

I'm working on the conjugate gradient method. I have the matrix A, defined as A= diag(v) where $v=[ones(1,10), 11:1000]$. I have to solve the system $Ax=b$ ,b=ones(1000,1) with the conjugate ...
0
votes
0answers
40 views

Find the inverse of $A+uB+vC+uvD+u^2E+v^2F$ where $A,B,C,D,E,F$ are symmetric.

Given scalars $u,v$ s.t. $0<u,v<1$, we seek the properties of the matrix defined by $$P=A+uB+vC+uvD+u^2E+v^2F$$ A is symmetric and positive definite. $B,C,D,E,F$ are symmetric, but might not ...
0
votes
0answers
10 views

How to find How to find ΔU if LU factorization of tridiagonal Matrix A is used to sovle system Ax=b?

How to find ΔU if LU factorization of tridiagonal Matrix A is used to solve system Ax=b? By using forward and back substitution to show that x̂ satisfies (L̂+ΔL)...
0
votes
0answers
116 views

How to decide if a system is ill conditioned when the matrix condition number is very different for different norms?

A linear system Ax=b is said to be ill-conditioned if the condition number (A)of the coefficient matrix A is far from 1. Consider the system $$\begin{align}x_1 = &b_1 \\ x_1+x_2 = &b_2 \\ ...
0
votes
0answers
25 views

How to find Common (invariant) Subspace between more than two Hankel Matrices?

Note: I am not a mathematician but a control engineer. A general nonlinear $n_{a}^{th}$ order discrete-time state-space model is described by the following equations: \begin{align} ...
0
votes
0answers
21 views

Prove if a square root of a Herimitian positive semi-definite matrix is also Herimitian positive semi-definite, then it is unique.

Prove if a square root of a Herimitian positive semi-definite matrix is also Herimitian positive semi-definite, then it is unique. Here is what I have done so far: By the spectrum theorem, suppose $...
0
votes
0answers
28 views

LU Decomposition simplification on a tridiagonal matrix

If I have a tridiagonal matrix that looks like Tn = diag[1, 3, 1], I can do LU Decomposition of it using n - 1 multiplications (by omitting multiplications with 1) but not n - 1 divisions, right? In ...
0
votes
0answers
23 views

A problem about the condition number

Given that $I\in R^{n\times n}$ is identity matrix and $||I||=1$.Assumed that Matrix $A\in R^{n\times n}$ is nonsingular,with $\delta A$ satisfying $||A^{-1}||||\delta A||<1$. Then $A+\delta A$ is ...
0
votes
0answers
17 views

Question related to matrix transformation in sequence spaces.

Let $M=[K_{i,j}]$ be an infinite matrix, where $K_{ij}=1/i \text{ if } 1\leq i \leq j \text{ and } K_{ij}=0 \text{ if } i>j\geq 1$. Then $M$ defines a map $\ell^p \to \ell^r$ iff $p=1 \text{ and } ...
0
votes
0answers
16 views

convergnece of QR-method

I'm studying the QR-algorithm. In particular I have this algorithm: For every $k=0..n $ select a shift $\sigma_k$ factorize $A_k-\sigma_k I =Q_kR_k$ multiply $A_{k+1}=R_k Q_k+\sigma_kI$ muliply ...
0
votes
0answers
46 views

Compression of a matrix A by V

I can't understand and even can't find any text on Compression of a matrix A by V. meaning if $B=V^*AV$ then B is called the compression of A. What does it mean???
0
votes
0answers
42 views

Solving for intersection of line and a vector function.

How would one approach a problem of finding intersection points between a line $\vec l = \vec S + d \vec t$ and vector of the form $$\vec v = \begin{pmatrix} x \\ y \\f(x, y) \end{pmatrix}$$ I am ...
0
votes
0answers
31 views

Improving my QZ-Algorithm (Include Shifts)

I Need to to solve an generalized Eigenvalue Problem and compare two Methods (QR and QZ) concerning their convergence rate and execution time. I started with the Basic QR-Algorithm, implemented in ...
0
votes
0answers
39 views

Rapid calculation of eigenvectors for a submatrix when I know the eigenvectors of the full matrix

I have an $N \times N$ matrix $Z$ that is complex-valued and nonsymmetric in general. I can solve for the eigenvalues and eigenvectors of this matrix numerically. Call the diagonal eigenvalue matrix ...
0
votes
0answers
85 views

Extracting I-Vectors from a GMM-supervector

The probability model for I-vector in GMM-UBM system is : M = M(ubm) + Ty where, M is GMM supervector (means of all gaussian components concatenated in single vector) M(ubm) is UBM supervector I ...
0
votes
0answers
10 views

Response Matrix with finit actuator

I have a system of penalties ($P$) and actuators($A$). Whereby: d$P_i/$d$A_j$ = close to constant $\quad\forall i,j$ In order to minimize $P$, I create a response Matrix ($M$). With its pseudo-...
0
votes
0answers
51 views

Looking for references on the complexity of computation of a basis transformation matrix

I'm looking for some references on the complexity for the following kind of problem: Given two Basis $(a_1, ... ,a_n)$ and $(b_1, ..., b_n)$ of the $K(x)$-vector space $V$ I want to compute the ...
0
votes
0answers
24 views

Speeding up Conjugate Gradients iterations for Sparse Matrices?

I've been using Conjugate Gradients to minimize linear systems involving sparse matrices. Although many of my sparse matrices are highly specialized - i.e. for any given row it is easy to know which ...