User fstab

5 votes

1 answer

8k views

How to calculate entropy from a set of samples?

asked Jul 22, 2015 at 8:12

3 votes

1 answer

88 views

Constrained nonlinear optimization

optimization convex-optimization lagrange-multiplier constraints maximum-likelihood

asked Nov 24, 2015 at 13:07

3 votes

3 answers

2k views

Any good introductory book/tutorial on Fourier Transform (up to FFT) with plenty of exercises and solutions?

calculus fourier-analysis self-learning fourier-series signal-processing

asked May 4, 2014 at 14:22

2 votes

2 answers

801 views

Row echelon form of (augmented) matrix. Is there something wrong with Sage's implementation?

linear-algebra sagemath

asked Aug 10, 2014 at 12:19

2 votes

0 answers

194 views

Reducing a linear algebra expression to quadratic form

linear-algebra matrices quadratic-forms machine-learning

asked Sep 9, 2014 at 21:43

2 votes

1 answer

4k views

What is the maximum amount of eigenvectors that a square matrix n x n might have?

linear-algebra eigenvalues-eigenvectors

asked Oct 23, 2013 at 10:14

2 votes

3 answers

111 views

Fun problem. Apparently $\prod_i(1-p_i) \geq 1 - \sum_ip_i$ with $p_i \in [0,1]$ is always true. But how to demonstrate it?

inequality proof-verification recreational-mathematics

asked Nov 9, 2014 at 18:29

2 votes

2 answers

358 views

If $g$ is a function of the random variable $X$, is it true that $H(X) = H(X) + H(g(X)\mid X)$?

probability random-variables conditional-probability information-theory entropy

asked Nov 10, 2014 at 16:35

1 vote

2 answers

271 views

stuck on logarithm of derivative of sum $\frac{\partial\mathrm{log}(a+b)}{\partial a}$

derivatives logarithms exponential-function partial-derivative

asked Oct 5, 2014 at 15:45

1 vote

1 answer

7k views

Stuck on derivative of logarithm of sum of exponentials

derivatives logarithms exponential-function partial-derivative exponential-sum

asked Oct 5, 2014 at 16:11

1 vote

2 answers

298 views

Given a Markov chain $X \rightarrow Y \rightarrow Z$, why is $I(X;Y|Z) \leq I(X;Y)$?

probability markov-chains conditional-probability information-theory entropy

asked Nov 18, 2014 at 20:58

1 vote

2 answers

85 views

being $\mathbf{w}$ a vector, how do I calculate the derivative of $\mathbf{w}^T\mathbf{w}$?

calculus linear-algebra vector-spaces products

asked Sep 14, 2014 at 20:44

1 vote

0 answers

41 views

Integrating an expression over a vector $\mathbf{w}$

calculus integration improper-integrals machine-learning

asked Sep 13, 2014 at 23:15

0 votes

0 answers

43 views

being $\mathbf{a}$ and $\mathbf{b}$ two vectors with same length, how do I expand $(\mathbf{a}^T\mathbf{b})^2$?

calculus linear-algebra vector-spaces products

asked Sep 14, 2014 at 19:30

0 votes

1 answer

49 views

maximum-likelihood: a sequence of events described by a Bernoulli distribution

probability probability-distributions parameter-estimation

asked Sep 17, 2014 at 12:35

0 votes

1 answer

734 views

Is a traditional Multi Layer Perceptron Network capable of non-linear regression? Which activation function should be used for that purpose?

regression machine-learning artificial-intelligence

asked Oct 27, 2013 at 13:23

0 votes

1 answer

39 views

name of plot for discrete joint probability (table) visualizing black squares of varying size per cell

probability-distributions graphing-functions

asked Jan 12, 2014 at 0:38

0 votes

1 answer

118 views

How to prove Markov's inequality $P_X(X\geq t) \leq \frac{\mathbb{E}[X]}{t}$?

probability probability-theory inequality probability-distributions estimation

asked Nov 19, 2014 at 15:32

0 votes

1 answer

322 views

Markov chain: if $X\rightarrow Y\rightarrow Z$, then why is $Z\rightarrow Y\rightarrow X$ true?

probability markov-chains conditional-probability bayesian bayes-theorem

asked Nov 18, 2014 at 20:06

0 votes

1 answer

120 views

What is the exact meaning of $I(X;Y|Z)$ in Information Theory?

probability conditional-probability information-theory entropy

asked Nov 18, 2014 at 20:12

0 votes

0 answers

85 views

How to identify what probability distribution this is?

probability statistics probability-distributions

asked Jan 17, 2016 at 11:19

0 votes

0 answers

120 views

How to efficiently select a subset of elements that maximizes a certain property? (entropy)

optimization computational-complexity entropy

asked Jul 22, 2015 at 8:52

Stack Exchange Network

current community

your communities

more stack exchange communities

22 Questions

How to calculate entropy from a set of samples?

Constrained nonlinear optimization

Any good introductory book/tutorial on Fourier Transform (up to FFT) with plenty of exercises and solutions?

Row echelon form of (augmented) matrix. Is there something wrong with Sage's implementation?

Reducing a linear algebra expression to quadratic form

What is the maximum amount of eigenvectors that a square matrix n x n might have?

Fun problem. Apparently $\prod_i(1-p_i) \geq 1 - \sum_ip_i$ with $p_i \in [0,1]$ is always true. But how to demonstrate it?

If $g$ is a function of the random variable $X$, is it true that $H(X) = H(X) + H(g(X)\mid X)$?

stuck on logarithm of derivative of sum $\frac{\partial\mathrm{log}(a+b)}{\partial a}$

Stuck on derivative of logarithm of sum of exponentials

Given a Markov chain $X \rightarrow Y \rightarrow Z$, why is $I(X;Y|Z) \leq I(X;Y)$?

being $\mathbf{w}$ a vector, how do I calculate the derivative of $\mathbf{w}^T\mathbf{w}$?

Integrating an expression over a vector $\mathbf{w}$

being $\mathbf{a}$ and $\mathbf{b}$ two vectors with same length, how do I expand $(\mathbf{a}^T\mathbf{b})^2$?

maximum-likelihood: a sequence of events described by a Bernoulli distribution

Is a traditional Multi Layer Perceptron Network capable of non-linear regression? Which activation function should be used for that purpose?

name of plot for discrete joint probability (table) visualizing black squares of varying size per cell

How to prove Markov's inequality $P_X(X\geq t) \leq \frac{\mathbb{E}[X]}{t}$?

Markov chain: if $X\rightarrow Y\rightarrow Z$, then why is $Z\rightarrow Y\rightarrow X$ true?

What is the exact meaning of $I(X;Y|Z)$ in Information Theory?

How to identify what probability distribution this is?

How to efficiently select a subset of elements that maximizes a certain property? (entropy)