User fstab

1 answers

5 votes

8k views

2 bookmarks

How to calculate entropy from a set of samples?

Jul 22 '15 at 8:12

3 answers

3 votes

2k views

Any good introductory book/tutorial on Fourier Transform (up to FFT) with plenty of exercises and solutions?

calculus fourier-analysis self-learning fourier-series signal-processing

May 4 '14 at 14:22

1 answers

3 votes

84 views

1 bookmarks

Constrained nonlinear optimization

optimization convex-optimization lagrange-multiplier constraints maximum-likelihood

Nov 24 '15 at 13:07

2 answers

2 votes

250 views

1 bookmarks

If $g$ is a function of the random variable $X$, is it true that $H(X) = H(X) + H(g(X)\mid X)$?

probability random-variables conditional-probability information-theory entropy

Nov 10 '14 at 16:35

3 answers

2 votes

111 views

1 bookmarks

Fun problem. Apparently $\prod_i(1-p_i) \geq 1 - \sum_ip_i$ with $p_i \in [0,1]$ is always true. But how to demonstrate it?

inequality proof-verification recreational-mathematics

Nov 9 '14 at 18:29

0 answers

2 votes

193 views

1 bookmarks

Reducing a linear algebra expression to quadratic form

linear-algebra matrices quadratic-forms machine-learning

Sep 9 '14 at 21:43

2 answers

2 votes

739 views

Row echelon form of (augmented) matrix. Is there something wrong with Sage's implementation?

linear-algebra sagemath

Aug 10 '14 at 12:19

1 answers

2 votes

4k views

1 bookmarks

What is the maximum amount of eigenvectors that a square matrix n x n might have?

linear-algebra eigenvalues-eigenvectors

Oct 23 '13 at 10:14

2 answers

1 votes

269 views

Given a Markov chain $X \rightarrow Y \rightarrow Z$, why is $I(X;Y|Z) \leq I(X;Y)$?

probability markov-chains conditional-probability information-theory entropy

Nov 18 '14 at 20:58

2 answers

1 votes

84 views

1 bookmarks

being $\mathbf{w}$ a vector, how do I calculate the derivative of $\mathbf{w}^T\mathbf{w}$?

calculus linear-algebra vector-spaces products

Sep 14 '14 at 20:44

2 answers

1 votes

244 views

stuck on logarithm of derivative of sum $\frac{\partial\mathrm{log}(a+b)}{\partial a}$

derivatives logarithms exponential-function partial-derivative

Oct 5 '14 at 15:45

1 answers

1 votes

7k views

1 bookmarks

Stuck on derivative of logarithm of sum of exponentials

derivatives logarithms exponential-function partial-derivative exponential-sum

Oct 5 '14 at 16:11

0 answers

1 votes

41 views

1 bookmarks

Integrating an expression over a vector $\mathbf{w}$

calculus integration improper-integrals machine-learning

Sep 13 '14 at 23:15

0 answers

0 votes

84 views

How to identify what probability distribution this is?

probability statistics probability-distributions

Jan 17 '16 at 11:19

0 answers

0 votes

112 views

2 bookmarks

How to efficiently select a subset of elements that maximizes a certain property? (entropy)

optimization computational-complexity entropy

Jul 22 '15 at 8:52

1 answers

0 votes

102 views

What is the exact meaning of $I(X;Y|Z)$ in Information Theory?

probability conditional-probability information-theory entropy

Nov 18 '14 at 20:12

1 answers

0 votes

117 views

How to prove Markov's inequality $P_X(X\geq t) \leq \frac{\mathbb{E}[X]}{t}$?

probability probability-theory inequality probability-distributions estimation

Nov 19 '14 at 15:32

1 answers

0 votes

246 views

1 bookmarks

Markov chain: if $X\rightarrow Y\rightarrow Z$, then why is $Z\rightarrow Y\rightarrow X$ true?

probability markov-chains conditional-probability bayesian bayes-theorem

Nov 18 '14 at 20:06

1 answers

0 votes

48 views

maximum-likelihood: a sequence of events described by a Bernoulli distribution

probability probability-distributions parameter-estimation

Sep 17 '14 at 12:35

0 answers

0 votes

41 views

being $\mathbf{a}$ and $\mathbf{b}$ two vectors with same length, how do I expand $(\mathbf{a}^T\mathbf{b})^2$?

calculus linear-algebra vector-spaces products

Sep 14 '14 at 19:30

1 answers

0 votes

39 views

name of plot for discrete joint probability (table) visualizing black squares of varying size per cell

probability-distributions graphing-functions

Jan 12 '14 at 0:38

1 answers

0 votes

716 views

Is a traditional Multi Layer Perceptron Network capable of non-linear regression? Which activation function should be used for that purpose?

regression machine-learning artificial-intelligence

Oct 27 '13 at 13:23

Stack Exchange Network

current community

your communities

more stack exchange communities

22 Questions