$p$ is a prime number. I use the method as following to find out the number of monic irreducible polynomials of degree 2.
Count the number of monic not irreducible polynomials of degree 2:
If a monic polynomial $f(x)\in \mathbb F_{p}$ is of degree 2 and not irreducible, $f(x)=(x-\alpha)g(x)$ for some $g(x) \in \mathbb F_{p}$.
As $deg(g)=2-deg(x-\alpha)=2-1=1$.So $g=x-\beta$ for some $\beta \in \mathbb F$.
Thus all the not irreducible monic polynomial of degree $2$ is of the form $f(x)=(x-\alpha)(x-\beta)$.
If $\alpha =\beta$ $f(x)=(x-\alpha)^2$. We have $p$ polynomials $f(x)$ in this form.
If $\alpha \neq \beta$ , we have ${p \choose 2}=\frac{p!}{2!(p-2)!}=\frac{p(p-1)}{2}$ polynomials $f(x)$ in this form.
Hence, the total number of monic not irreducible polynomials of degree $2$ in $\mathbb F_{p}[x]$ is $p+\frac{p(p-1)}{2}=\frac{p(p+1)}{2}$
Monic polynomial of degree $2$ in $\mathbb F_{p}[x]$ has the form $x^2+ax+b$ with $a,b \in\mathbb F_{p}[x]$. Thus we have $p^2$ such polymials.
Thus the number of irreducible polynomial of degree $2$ in $\mathbb F_{p}[x]$ is $p^2-\frac{p(p+1)}{2}=\frac{p^2-p}{2}$
But when I turn to find out the number of monic irreducible polynomials of degree 3.
I find that all the not irreducible monic polynomial of degree $2$ is of the form $f(x)=(x-\alpha)(x^2+cx+d)$,so it seems that we have $p$ choices of $\alpha$, $p$ choices of $c$ and $p$ choices of $d$, thus we have $p^3$ not irreducible polynomials of degree $3$ in $ \mathbb F_{p}$.
But monic polynomial of degree $3$ in $\mathbb F_{p}[x]$ has the form $x^3+a_{1}x^2+a_{2}x+a_{3}$ with $a_{1},a_{2},a_{3} \in\mathbb F_{p}[x]$. Thus we have $p^3$ such monoc polymials.
So I think my counting when I try degree 3 is wrong.
I use the method as following to find out the number of monic irreducible polynomials of degree 4.
By using counting argument I have found that the number of irreducible polynomial of degree $2$ in $\mathbb F_{p}[x]$ is $p^2-\frac{p(p+1)}{2}=\frac{p^2-p}{2}$.
And we have $p^3-\frac{2p^3+p}{3}=\frac{p^3-p}{3}$ monic irreducible polynomials of degree $3$.
EDIT: Now I am doing the case of degree 4, could someone please have a look to my counting to see if it is correct? Thanks so much!
Monic polynomials of degree $4$ is of the form $x^4+a_{1}x^3+a_{2}x^2+a_{3}x+a_{4}$
where$a_{1},a_{2},a_{3},a_{4}$. Thus we have $p^4$ of them.
Let $f(x)$ be a not irreducible monic polynomials of degree $4$, then there are several possible form of $f(x)$
(i):$f(x)=(x-\alpha)(x-\beta)(x-\gamma)(x-\delta)$ with $\alpha,\beta,\gamma,\delta \in \mathbb F_{p}$.
(ii):$f(x)=(x-\alpha)(x-\beta)(x^2+ax+b)$ with $\alpha,\beta,a,b \in \mathbb F_{p}$ and $(x^2+ax+b)$ is a irreducible polynomial of degree $2$.
(iii)$f(x)=(x^2+ax+b)(x^2+cx+d)$ with $a,b,c,d \in \mathbb F_{p}$ and $(x^2+ax+b), (x^2+cx+d)$ are irreducible polynomials of degree $2$.
(iv)$f(x)=(x-\alpha)(x^3+ax^2+bx+c)$ with $\alpha,a,b,c \in \mathbb F_{p}$ and $(x^3+ax^2+bx+c)$ is a irreducible polynomial of degree $3$. We have $p+3{p \choose 2}+3{p \choose 3}+{p \choose 4}$ monic reducible polynomials of degree $4$ of form (i). $(p+{p \choose 2})\frac{p^2-p}{2}$ monic reducible polynomials of degree $4$ of form (ii). $\frac{p^2-p}{2}+{\frac{p^2-p}{2} \choose 2}$ monic reducible polynomials of degree $4$ of form (iii). and $p(\frac{p^3-p}{3})$ monic reducible polynomials of degree $4$ of form (iv).
But the wolfram alpha does not give me the desire number of number of irreducible polynomials of degree 4. So I guess something is wrong.
Could someone help me to find out what is wrong here and show the correct way? Thanks in advance!