Norm is a function on a vector space $X$ which generalizes notion of length of vector in general vector spaces.

learn more… | top users | synonyms

1
vote
1answer
33 views

Can anyone help out with this proof, certain steps are unclear. Norm of linear operator.

I have the following norm defined as follows (in $R^n$, $x=(x^1,x^2,\ldots,x^n)\ $)$\| x\|_1= \sum_{i=1}^{n}|x^i|$ Let $A:R^m \to R^n$ a linear map of the spaces $(R^m ,\| \cdot \|_1 )$ and $((R^n ...
1
vote
0answers
1k views

Matrix Norms Inequality Proof

How do I prove this inequality / equivalence about matrix p-norms? It appears on the wikipedia and mathworld.wolfram pages on matrix norms without proof. $\|A\|^2_2 \leq \|A\|_1 \|A\|_\infty$ Maybe ...
0
votes
1answer
18 views

How to computer the proximal operator of a indicator function?

For $G_{1}(x) = I_{c}(x), c =\{x|Ax=b\}$, the Proximal operator is: $Prox_{\gamma G_{1}}(x) = Proj_{c}(x) = x + A^{T}(AA^{T})^{-1}(y-Ax)$ I hope to know, how to derivative this result. And, for ...
1
vote
1answer
14 views

Comparison of the norms of two non-negative real-valued vectors differing only in one component.

Let $0 \leq a \leq b$ and let $\mathbf{x} \in \mathbb{R^{n}}$. Let $\|.\|$ be a norm over $\mathbb{R}^{n+1}$. If we write $( \mathbf{x},a)$ the vector of $ \mathbb{R}^{n+1}$ made by concatening ...
1
vote
1answer
17 views

Can varying $p$ in the $p$-norm induced distanced change which pair of points are closer?

i.e. For some $x, y, z \in \mathbb{R}^{n}$, do there exist $p_{1}, p_{2}$ s.t. $ 0 < \sum_{i=1}^{n} (|x_{i} - y_{i}|^{p_{1}} - |x_{i} - z_{i}|^{p_{1}})$ and $ 0 \ge \sum_{i=1}^{n} (|x_{i} - ...
1
vote
1answer
12 views

Bound on maximum of product of matrix and vector

I need to bound the absolute maximum of each entry of a matrix-vector product: $\max_{|x|_{1}=1} |Ax|_{\infty}$ I tried to pose this in terms of the induced infinity norm of $A$, as in ...
2
votes
0answers
24 views

Operator Norm and Submultiplicativity against the Spectral Norm

Consider $\mathcal{A}:\mathbb{R}^{n\times m}\to \mathbb{R}^{p\times q}$ to be a linear operator. I know that by considering the trace norm and using the submultiplicativity of the operator norm we ...
1
vote
1answer
40 views

Find the norm of operator

Let we have the following operator $$T:\ell_p \rightarrow \ell_p$$ $T(ξ_1,ξ_2,ξ_3,ξ_4,ξ_5,ξ_6,ξ_7,ξ_8,ξ_9,ξ_{10},ξ_{11},ξ_{12},ξ_{13},ξ_{14},..)=(ξ_1,ξ_3,ξ_5,ξ_7,ξ_9,ξ_{11},ξ_{13},...)$ How can I ...
0
votes
0answers
15 views

Calculating Cosine Similarity with Matrix Decomposition (matrix multiplication with normalized columns)

To calculate the column cosine similarity of $\mathbf{R} \in \mathbb{R}^{m \times n}$, $\mathbf{R}$ is normalized by Norm2 of their columns, then the cosine similarity is calculated as ...
1
vote
1answer
20 views

Operator norm on $M_n(A)$ where $A$ is a Banach algebra

On $M_n(\mathbb{C})$, if we take the operator norm by acting on $\mathbb{C}^n$ where $||(z_1,\ldots,z_n)||=\max_{1\leq i\leq n}||z_i||$, then for $[a_{ij}]\in M_n(\mathbb{C})$ we have ...
3
votes
1answer
51 views

A Real Matrix, its Kernel and Image

This is an old exam problem: For an $m \times n$ real matrix $A$, define $\ker A = \{x \in \mathbb{R}^n \mid Ax=0 \}$ and $\operatorname{Im} A = \{Ax \mid x \in \mathbb{R}^n \}$. Show that for all $b ...
1
vote
0answers
22 views

How can we check that for a given norm, we can found an inner product?

Let $$\Bbb C^2=\{w=(z_1,z_2) : z_1,z_2\in\Bbb C\}$$ be the vector space of all ordered pairs of complex numbers. Can we obtain the norm defined on $\Bbb C^2$ by $$||w||=|z_1|+|z_2|$$ from an inner ...
1
vote
1answer
44 views

Can I solve a problem like a combination of PCA and compressed sensing?

$$ \underset{A,x}{\text{minimize}} \quad \lambda \left\| x \right\|_{1} + \left\| A \right\|_{*} $$ $$ D = A + Mx $$ Where $M \in \mathbb{R}^{n \times m}$, $x \in \mathbb{R}^{m \times z}$, $E=Mx \in ...
0
votes
4answers
130 views

Show that $A^{n}\to0$ if and only if $\|A\|^{n}\to0$

Let $\boldsymbol{A}$ be a square matrix. Show that $\lim_{n\to\infty}\boldsymbol{A}^{n}=0$ if and only if $\lim_{n\to\infty}\|\boldsymbol{A}\|^{n}=0$ for the spectral radius or for some operator ...
0
votes
1answer
39 views

Finding a metric such that $\Phi$ becomes a contraction

Let $$ f:\:[0,1]\rightarrow\mathbb{R};\\ \Phi: \mathcal{F}([0,1], \mathbb{R}) \rightarrow \mathcal{F}([0,1], \mathbb{R}),\\ f\mapsto\Phi(f):=Φf := \left(x\mapsto\left\{ ...
3
votes
0answers
37 views

Equivalence of norms in $C^1[0,1]$

i have the following problem/questions: I have to prove that $\lVert \cdot \rVert_1 \sim \lVert \cdot \rVert_{*} $ in $C^1[0,1]$; Where $\lVert \cdot \rVert_1$ is the usual $C^1[0,1]$ norm and ...
0
votes
0answers
15 views

Spectral radius and matrix norm inequality as its consequence

I am trying to undestand a proof and there is one part that's holding me back. By assumption we have that spectral radius $\rho(A) < 1$. Hence, following inequality should hold $$\|A^k\| < C ...
0
votes
0answers
21 views

Derivative with respect to a 2-norm

Given $f = f(u(t), t)$, is it possible to find the following derivative? ($f$,$u \in \mathbb{R}^n$, $t \in \mathbb{R}$) $$ \frac{\partial f}{\partial||u||^2_2} $$ I am aware of the following ...
0
votes
1answer
22 views

Unique minimizer of $\|x\|_{\mathcal A}$ subject to $\Phi x=\Phi x_0$

I'm trying to understand the proof of Lemma 2.3 of the paper Simple bounds for recovering low-complexity models. The authors want to find bounds on the numbers of rows $m$ of $\Phi$ to ensure that ...
4
votes
2answers
39 views

How do I find $\|T\|$ when given a matrix $T$?

How do I find the norm $\|T\|$ of T: $\mathbb{R}^3 \rightarrow \mathbb{R}^3$ is defined by $T(x) := Ax$, where $A:= \begin{pmatrix} 0 & 2 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 3 ...
1
vote
1answer
17 views

Matrix factorization inequality

How does one show that the following matrix factorization inequality holds in $M_{n} (\mathcal{A})^{+}$, $$(a_{i}^{*}a^{*}aa_{j}) \leq ||a^{*}a|| \cdot (a_{i}^{*}a_{j})$$ Notation. Let $M_{n} ...
0
votes
0answers
16 views

Does unitary transformation preserves the max of norm-2 of lower dimensional vectors?

Let $\{\mathbf{e}_i\in\mathbb{R}^n, i=1,...,N\}$. Apply a unitary transformation of the form $\mathbf{U}_N\otimes\mathbf{I}_n$ to this vector set and reach to vector set ...
2
votes
0answers
38 views

Find Solution regarding 2-Norm

I try to understand that, but I have no clue what do to and how to do it. $A$ is a $m \times n$ matrix with $rg(A)=m$. Find the solution for $Ax = b$, which is regarding to the $2$-norm (I guess ...
0
votes
1answer
1k views

How to describe minimization of L1 norm error using linear programming?

Given a set of $n$ pair points $(x_1, y_1), ..., (x_n, y_n)$ in the plane, I need to find a line $ax + by = c$ that fits the points of the L1 norm error points as closely as possible. I need a linear ...
3
votes
1answer
17 views

orthogonality-like in vector normed space

Given a normed real vector space $V$, and a vector $x\ne 0$, there exists a vector $y\ne 0$ such that $\|x+y\|=\|x-y\|$? I know that it exists if the norm is induced by a scalar product (in ...
0
votes
1answer
52 views

Dense subsets in tensor products of Banach spaces

Assume $B_1$ and $B_2$ are Banach spaces of univariate functions. Moreover, assume that the sets $D_1 \subset B_1$ and $D_2 \subset B_2$ are dense with respect to the respective norms ...
4
votes
1answer
86 views

Taylor series approximation of function under norm

I am reading this paper. At page number $4$, term $||Au - f||^{2}$ is approximated by taylor series approximation around $u^{k}$. The resulting approximations are $$\|Au - f\|^{2} \approx ...
1
vote
1answer
40 views

A question on Hölder inequality [duplicate]

Let $p, q > 1$ such that $\frac{1}{p} + \frac{1}{q} = 1$. Then $$|\sum\limits_{i = 1}^n x_i y_i| \leq ||x||_p ||x||_q, \;\; \forall x, y \in \mathbb{R}^n.$$ I have to prove it considering $$u = ...
0
votes
1answer
14 views

Prove that there is an inner product on $\mathbb{R}^2$, given that the associated norm is a p-norm only if p = 2

Prove that there is an inner product on $\mathbb{R}^2$, such that the associated norm is given by: $ \parallel (x,y) \parallel = (|x|^p + |y|^p)^\frac{1}{p}$ where $ p > 0 $ only if $ p = 2 $ So ...
0
votes
1answer
37 views

Functional analysis: $\|A\|=\sup\{|\langle Ax,x\rangle|\mid x\in X, \|x\|\leq 1\}$

Let $(X,\langle\cdot ,\cdot\rangle)$ an inner product space and $A\in\mathcal L(X)$. I have to show that $$\|A\|=\sup\{|\langle Ax,x\rangle|\mid x\in X, \|x\|\leq 1\}.$$ The fact that $\|A\|\geq ...
0
votes
0answers
16 views

How much similar two large matrices are-a practical approach

I'm wondering is there any method to check how much similar two matrices are? For example the following three matrices $A = \left[ {\begin{array}{*{20}{c}} 1&1\\ 1&1 \end{array}} \right],B = ...
0
votes
0answers
34 views

taking a tricky limit $\lim_{p\rightarrow \infty} \int_{\mathbb R^N} \left( \frac{|\nabla u|}{\|\nabla u\|_p}\right)^{p-2} \cdots $

$$\lim_{p\rightarrow \infty} \int_{\mathbb R^N} \left( \frac{|\nabla u|}{\|\nabla u\|_p}\right)^{p-2} \frac{\nabla u}{\|\nabla u\|_p}\cdot \nabla v dx \quad\quad \star$$ where $|\cdot|$ is the ...
5
votes
4answers
263 views

Why are we defining the norms on certain vector spaces the way they are?

What's the intuition behind defining $\|x\|_{\infty} = \max_{1 \le i \le n}\{|x_i|\}$ on the space of ordered $n$-tuples of complex numbers? I'm asking because I've been asked to find a norm on the ...
1
vote
1answer
22 views

Tightness of inequalities for various matrix norms

For a general inequality involving matrix norms, does the choice of the norm influence the tightness of the inequality? Eg. In $\|AB\| \leq \|A\| \|B\|$, Does the choice of the norm affect the ...
0
votes
1answer
19 views

Strict inequality of vector norms

Given a non orthogonal projection $p$ and non zero vector $x$. I am going to prove that $$\|Px\|<c\|x\|$$ for some $c<1$, where $\|\cdot\|$ is the usual Euclidean norm. I can only have the ...
2
votes
1answer
59 views

In a normed vector space $(V,\lvert . \rvert)$ show that $f:V\rightarrow \mathbb{R}$ with $f(v)=\lvert v\rvert$ is uniformly continuous

In a normed vector space $(V,\lvert . \rvert)$ show that $f:V\rightarrow \mathbb{R}$ with $f(v)=\lvert v\rvert$ is uniformly continuous The first part of the question says to prove the "reverse ...
1
vote
1answer
45 views

Showing that a map $x \to \|x\|$ is continuous?

I am given this: Consider a real Banach space $X$ with norm $\|*\|$. 1) Show that the map $x\to \|x\|$ from $X$ to $\mathbb{R}$ is continuous. Is it uniformly continuous? 2) Show that the maps ...
0
votes
0answers
27 views

On norms for “more complicated objects”

Whilst studying norms (via various routes) I was always confused by the following definition for some object $\phi$, $$\|\phi\|_p=\sup_{x\in A,x\neq 0}\frac{\|\phi x\|_p}{\|x\|_p}=\sup_{x\in ...
2
votes
1answer
27 views

matrix operator norm and inner product

Is it true that $\Vert A\Vert:=\sup_{\Vert x\Vert=1}\Vert Ax\Vert=\sup_{\Vert x\Vert=\Vert y\Vert=1}\vert\langle y,Ax\rangle\vert$ for arbitrary matrices $A$? Showing $"\geq"$ seems to be ...
1
vote
1answer
47 views

Completeness in $L^p$ and supremum norms

As seen by this question, $C([0,1])$ is not complete in the $L^p$ norm ($1 \le p < \infty$) because one can choose a Cauchy sequence $$f_n(x) := \begin{cases} 0 & \text{if $0 \le x \le ...
1
vote
1answer
71 views

Why is the Euclidian norm used to measure complex numbers?

Why is the Euclidian norm used to measure complex numbers? The complex numbers are numbers (or more precisely, pairs of numbers), and I can't see why are they essentially connected to the ...
4
votes
2answers
33 views

Norm of the operator $T:\ell^2 \to \ell^2$ defined as $(Tx)_1=0, (Tx)_n=-x_n+\alpha x_{n+1}$

Consider the operator $T: \ell^2 \to \ell^2$ defined as $$\begin{cases} (Tx)_1 = 0, \\ (Tx)_n = -x_n + \alpha x_{n+1}, \quad n\ge 2 \end{cases} $$ where $\alpha \in \mathbb{C}$. I want to find ...
2
votes
1answer
110 views

Are these two definitions for dual norm equivalent

Suppose there is a $p$-norm $\left\|\cdot\right\|_p$, the dual function at $z$ of it is, $$\sup\left\{ z^{T} x-\left\|x\right\|_p:x\in\mathbb{R}^n\right\}$$ The second is, $$ \sup\left\{ z^{T} x : ...
5
votes
1answer
45 views

Is there a nowhere differentiable norm on $\Bbb R^n$?

Is there a nowhere differentiable norm on $\Bbb R^n$? The non differentiable norms that I know (e.g. the one norm $\|\cdot\|_1$ and the infinity norm $\|\cdot\|_{\infty}$) are non differentiable ...
1
vote
1answer
32 views

How can I find a norm of a linear transformation $T(x,y) = (ax+cy, bx+dy)$?

Let a linear transformation $T : \mathbb{C}^2 \to \mathbb{C}^2$ s.t $T(x,y) = (ax+cy, bx+dy)$ where $a,b,c,d \in \mathbb{C}$. Now, find the norm of T equipped with ($\mathbb{C}^2$ , $l^1(\{1,2\})$ ...
1
vote
0answers
22 views

Do tensor norms exist?

Does there exist norms for tensors, as an extension for the ordinary matrix norm? For example, if there is a derivative of a matrix [A] with respect to a vector {x}, does the norm of this derivative ...
1
vote
1answer
23 views

Taking limits of norms of a matrix raised to the nth power:

Given a matrix $$ A = \begin{bmatrix} 0 & 3 \\ -2 & 5 \\ \end{bmatrix} $$ and a vector $x = \begin{bmatrix}1&0\end{bmatrix}$, compute ...
3
votes
0answers
37 views

Calculating Norms for the Transpose

How does one show that the transpose mapping $T: \mathcal{M}_{n} \to \mathcal{M}_{n}$, given by $T(a)=a^{t}$, has norm $||T||=1$ but completely bounded norm $||T||_{CB}=n$? Notation. ...
1
vote
1answer
24 views

Compute the limit of this expression of norms:

Compute the limit, as n goes to infinity, of the quotient: $$\frac{||A^{n+2}(x)||}{||A^n(x)||} $$, given the matrix $$ \begin{bmatrix} 0 & 3 \\ -2 & 5 \\ ...
1
vote
1answer
50 views

Dual norm of induced norm on matrices

Given a norm on a (finite dimensional) vector space $V$, we can define the induced norm on linear maps from $V \rightarrow V$, by $\|M\|_{I(V)} = \sup\limits_{\|x\|=1}\|Mx\|$. It is also true that ...