6 Proof for convergence of stochastic gradient descent to a local optimum for non convex functions 3 Orthogonal Projection onto the Unit Simplex 2 Convergence Rate and Complexity of Single SGD update for Neural Networks 2 is a solution of an ILP with local solvers optimal? 2 Interchange Argmin and Monotone Function

### Reputation (1,428)

 +10 Proof for convergence of stochastic gradient descent to a local optimum for non convex functions +10 The convex envelope of a lower semicontinuous function on a compact convex set is lower semicontinuous +10 Orthogonal Projection onto the Unit Simplex +10 Properties of this argmin function

### Questions (15)

 4 Law of large numbers holding uniformly with respect to a distribution 4 Sufficient conditions for continuous functions of continuous random variables to themselves be continuous random variables 3 If there always a supporting hyperplane $H$ through an extreme point $x$ of a convex set $X$ such that $H\cap X=\{x\}$? 3 The convex envelope of a lower semicontinuous function on a compact convex set is lower semicontinuous 2 Law of large numbers for functions of perturbed random variables

### Tags (65)

 33 optimization × 27 4 nonlinear-optimization × 5 11 convex-optimization × 12 4 integer-programming × 3 6 numerical-methods 4 linear-algebra × 3 6 stochastic-approximation 3 probability × 7 5 non-convex-optimization × 3 3 real-analysis × 6

### Bookmarks (129)

 719 What's an intuitive way to think about the determinant? 170 Self-Contained Proof that $\sum\limits_{n=1}^{\infty} \frac1{n^p}$ Converges for $p > 1$ 128 What are some examples of a mathematical result being counterintuitive? 87 Decidability of the Riemann Hypothesis vs. the Goldbach Conjecture 77 What is the intuition behind uniform continuity?