There is a nice proof in Titchmarsh's "The Theory of the Riemann Zeta Function": putting $\,[x]=\,$ the greatest integer not greater than $\,x\in\mathbb R\,$, we get:
$$\lim_{x\to 1^+}\left[\zeta(s)-\frac{1}{s-1}\right]\stackrel{\mathbf{(7)}}=\int_1^\infty\frac{[x]-x+\frac{1}{2}}{x^2}\,dx+\frac{1}{2}=\\=\int_1^\infty\frac{[x]-x}{x^2}+\frac{1}{2}\int_1^\infty\frac{dx}{x^2}+\frac{1}{2}=\int_1^\infty\frac{[x]-x}{x^2}\,dx+1=$$$$=\lim_{n\to\infty}\left[\sum_{m=1}^{n-1}\left(\int_m^{m+1}\frac{[x]dx}{x^2}-\int_m^{m+1}\frac{dx}{x}\right)+1\right]=$$$$\lim_{n\to\infty}\left[\sum_{m=1}^{n-1}m\left(\int_m^{m+1}\frac{dx}{x^2}\right)-\log n+1\right]=$$$$=\lim_{n\to\infty}\left[\left(1-\frac{1}{2}+1-\frac{2}{3}+...+1-\frac{m-1}{m}\right)+1-\log n\right]=$$$$=\lim_{n\to\infty}\left(\sum_{m=1}^{n-1}\frac{1}{m+1}+1-\log n\right)=\lim_{n\to\infty}\left(\sum_{m=1}^n\frac{1}{m}-\log n\right)=:\gamma$$
Finally, since we know $\,\displaystyle{\lim_{s\to 1^+}(s-1)\zeta(s)=1}\,$, we have that $\,s=1\,$ is a simple pole of $\,\zeta(s)\,$ with residue $\,1\,$, so the above gives the free coefficient of the Laurent expansion of $\,\zeta(s)\,$ around $\,1$
Proof of (7): We use the next form of Abel's summation by parts formula (all the time, $\,n\in\mathbb N\,$):
Lemma: Let $\,\phi(x)\,$ be any function with continuous derivative in $\,[a,b]\,$, then
$$\sum_{a< n\leq b}\phi(n)=\int_a^b\phi(x) dx+\int_a^b\left(x-[x]-\frac{1}{2}\right)\phi'(x)dx+\left(a-[a]-\frac{1}{2}\right)\phi(a)-\left(b-[b]-\frac{1}{2}\right)\phi(b)\,\,\,\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\color{blue}{(1)}$$
$\color{red}{\text{Proof}}$: Taking $\,a=n\,,\,b=n+1\,$ and integrating by parts we get at once:
$$\int_n^{n+1}\left(x-n-\frac{1}{2}\right)\phi'(x)dx=\left.\left(x-n-\frac{1}{2}\right)\phi(x)\right|_n^{n+1}-\int_n^{n+1}\phi(x)dx=$$
$$=\frac{1}{2}\left(\phi(n)+\phi(n+1)\right)-\int_n^{n+1}\phi(x)dx\Longrightarrow$$
$$\Longrightarrow \int_n^{n+1}\phi(x)dx+\int^{n+1}_n\left(x-[x]-\frac{1}{2}\right)\phi'(x)dx+\left(n-[n]-\frac{1}{2}\right)\phi(n)-\left(n+1-[n+1]-\frac{1}{2}\right)\phi(n+1)=\phi(n+1)=\sum_{n<m\leq n+1}\phi(m)\,\,,\,\,m\in\mathbb N$$
which shows both that the formula works for the above particular case and that it's enough to check for the case $\,n\leq a<b\leq n+1\,$ , so again integrating by parts:
$$\int_a^b\left(x-n-\frac{1}{2}\right)\phi'(x)dx=\left(b-n-\frac{1}{2}\right)\phi(b)-\left(a-n-\frac{1}{2}\right)\phi(a)-\int_a^b\phi(x)dx$$
Comparing with the equality promised by the lemma, we see the RHS of $\,(1)\,$ above reduces to
$$-\left(b-[b]-\frac{1}{2}\right)\phi(b)+\left(b-n-\frac{1}{2}\right)\phi(b)=\left([b]-n\right)\phi(b)$$
and this equals zero unless $\,b=n+1\,$, but then the last expression above equals $\,\phi(b)=\phi(n+1)\,$, which is the LHS in $\,(1)\,\;\;\;\;\;\;\;\square$
Now $\,(7)\,$ follows from the above with
$$a_n=1\,\,,\,\forall n\in\mathbb N\,\,,\,\,\phi(n):=n^{-s}\quad\text{ and }\quad\,\,A(x):=\sum_{0\leq n\leq x}a_n=[x]$$
and we get
$$\zeta(s):=\sum_{n=1}^\infty\frac{1}{n^s}=\sum_{n=1}^\infty a_n\phi(n)=s\int_1^\infty\frac{[x]dx}{x^{1+s}}$$
Finally, we just write
$$\frac{1}{s-1}=\int_1^\infty\frac{dx}{x^s}$$