Derivation of Dirac delta function Is there anyone could give me a hint how to find the distributional derivative of the delta function $\delta$? I don't know how to deal with the infinite point.
 A: $\delta$ is NOT a function. $\delta$ is what's called a distribution. A distribution is a "linear functional" $\delta\colon C_c^{\infty}(\Bbb{R})\to\Bbb{R}$. Where $C_c^{\infty}(\Bbb{R})$ are infinitely differentiable functions that vanish outside of some interval. 
We typically write (although this is absolutely an abuse of notation, this is not really an integral):
$$\delta(f)=\int_{-\infty}^{\infty} \delta(x)f(x)~dx$$
We define the distributional derivative through "integration by parts" (note the quotes. Since this is not really an integral integration by parts is not totally correct. This is heuristics). Meaning:
$$\begin{align*}
\delta'(f)&=\int_{-\infty}^{\infty} \delta'(x)f(x)~dx\\
&=-\int_{-\infty}^{\infty}\delta(x)f'(x)\\
&=-f'(0)\end{align*}$$
Where the first to second line is integration by parts (and noting the boundary terms vanish).
So the derivative of $\delta$ is the linear functional $f\mapsto -f'(0)$.
To truly understand distributions you need to learn functional analysis. Also see distributions. I did abuse a lot of notation and was quite informal. Distribution theory formally requires functional analysis. Please see comments below for further clarifications.
A: Upon request in the comments:
There is a large class of distributions which are given by integration against locally integrable functions. Specifically, given a locally integrable $f$ and a smooth compactly supported $g$, one can define $T_f(g)=\int_{-\infty}^\infty f(x) g(x) dx$. This leads to a common abuse of notation, where we write the same thing for distributions which are not given by integration against a locally integrable function. Thus we write things like $\delta(f)=\int_{-\infty}^\infty \delta(x) f(x) dx$, even though "$\delta(x)$" is meaningless by itself.
This abuse of notation turns out to be productive, because we can often define operations in distribution theory by passing to an approximating sequence, performing the operation on the approximating sequence (where it is defined the way we want) and then taking a limit. For example, if $T_{f_n} \to T$ and $f_n$ are smooth, then we can define $T'$ (the distributional derivative) to be $\lim_{n \to \infty} T_{f'_n}$. But with $T'_{f_n}$ we can really integrate by parts, which gives the formula $T'(g)=-T(g')$. Note that the result does not involve the approximation scheme, so we can just call this formula the "distributional derivative" and forget about approximating it.
The abuse of notation hints at trying such manipulations. Often people write them out without mentioning any approximation scheme. In this case the manipulations are called "formal", because they only pay attention to "form" without worrying about semantics. (This is the same use of the word as in "formal power series".)
Anyway, in the case of the Dirac delta, this procedure winds up telling you that $\delta'(f)=-f'(0)$ since by definition $\delta(f)=f(0)$.
