I am trying to derive the fisher information matrix for multinomial distribution. I know the pmf for it is:

$$f(x_1,x_2,..x_k;n,p_1,p_2,..p_k) = \frac{\Gamma(\sum_ix_i+1)}{\prod_i\Gamma(x_i+1)}\prod_i^k{p_i}^{x_i}$$

To simplify the calculation instead of calculating $I(n,P)$ I can calculate $nI(1,P)$: $$f(x_1,x_2,..x_k;1,p_1,p_2,..p_k) = \prod_i^k{p_i}^{x_i}$$ $$ I(n,P) = E[\frac{\partial ^2}{\partial P^2} \log(f(X,P))|P]$$

I am not getting the right answer with this calculation and I think the problem is I am not including the equality constraint $\sum_i p_i = 1$ within the pmf. I would appreciate if someone can help me with the derivation.

  • $\begingroup$ Try to replace $p_n$ by $1-p_1-\ldots-p_{n-1}$ and $x_n$ by $(1-x_1-\ldots-x_{n-1})$ as here: stats.stackexchange.com/q/153997 And also put $-n$ in front of the expectation calculating $I(n,p)$. $\endgroup$
    – NCh
    Apr 18 '17 at 1:46

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.