# Coordinate Lipschitz constant vs standard Lipschitz constant

Let $f: \mathbb{R}^n \mapsto \mathbb{R}$ a convex a continuously differentiable function.

What is the relation between the component Lipschitz constants, i.e. the smallest constants $L_i$ such that for all $x \in \mathbb{R}^n$ and $t \in \mathbb{R}$: $$|[\nabla f(x+te_i)]_i-[\nabla f(x)]_i| \leq L_i|t|,$$ and the regular Lipschitz constant, i.e. the smallest constant $L$ such that for all $d \in \mathbb{R}^n$: $$\|\nabla f(x+d)-\nabla f(x)\|_2 \leq L\|d\|_2?$$

It is mentioned it this paper that $1 \leq \frac{L}{L_{\text{max}}} \leq n$ where $L_{\text{max}} = \max_{i=1..n}L_i$, which comes from the "relationships between norm and trace of a symmetric matrix" (p.12). However I do not see where this result comes from, or which "symmetric matrix" the author refers to.

• Notice that Lipschitz constants aren't unique. If $L$ is a Lipschitz constant then any $M> L$ is also a Lipschitz constant. So please be more specific about $L$ and $L_i$. May 18, 2018 at 19:09

Since $$M=L\text{I} - \nabla^2 f \succeq 0$$, all diagonal entries of $$M$$ must be non-negative. Thus, $$L \geq L_{\max}$$. The equality holds when, for example, $$f(x)=\frac{1}{2} \sum_{i=1}^n x_i^2.$$

The second inequality comes from

$$L = \max_i \lambda_i \leq \sum_{i=1}^n \lambda_i = tr(\nabla^2 f) = \sum_{i=1}^n \partial^2 f_i \leq n L_{\max} ,$$

where $$\lambda_i \geq 0$$ is the ith eigenvalue of the Hessian. When $$f(x)= \frac{1}{2} (\sum_{i=1}^n x_i)^2 = \frac{1}{2} (1^T x)^2$$, the equality holds.

• Why does the sum of the eigenvalues equal the trace of the hessian? The hessian is symmetric but does not have to be diagonal?!? Jul 3, 2020 at 17:03
• math.stackexchange.com/questions/546155/… Jul 4, 2020 at 18:26
• Many thanks for this link. I did not expect that you would answer since this thread is 2 years old. So again many thanks. Are you familiar with the above mentioned paper? Jul 4, 2020 at 18:34
• Yes. I read it 2 years ago... Jul 4, 2020 at 18:55
• $f$ here doesn't need to be quadratic Jul 5, 2020 at 8:24

So does the above mentioned relationship $$1 \leq \frac{L}{L_{\text{max}}} \leq n$$ hold for every convex, twice differentiable function with Lipschitz-continuous gradient or only for quadratic convex functions?

On page 20 of this paper it says:

"We noted in Subsection 3.2 that the ratio $$L/L_{max}$$ lies in the interval $$[1,n]$$ when $$f$$ is a convex quadratic function and both parameters are set to their best values."

Many thanks again.

• Is this an answer or a question (in which case it should posted as a comment or an independent post in a new thread) ? Dec 23, 2020 at 22:12