Just to hammer home the point made by @NoahSchweber
Beginners, in week one of their first logic course, have the contrast between deductive and inductive arguments dinned into them. So emphatically is the distinction made, so firmly are they drilled to distinguish conclusive deductive argument from merely probabilistic inductions, that some students can't help feeling initially pretty uncomfortable when they first hear of 'induction' being used in arithmetic!
So let's be clear. We have a case of empirical, non-conclusive, induction, when we start from facts about a limited sample and infer a claim about the whole population. We sample some swans, for example, and run $k$ checks showing that $\varphi(0)$, $\varphi(1)$, $\varphi(2), \ldots, \varphi(k)$ are all true (where $\varphi(n)$ says that swan #$n$ is white). We hope that these are enough to be representative of the whole population of swans, and so -- taking a chance -- we infer that for all $n$, $\varphi(n)$, now quantifying over over all (numbers for) swans, jumping beyond the sample of size $k$. The gap between the sample and the whole population, between the particular bits of evidence and the universal conclusion, allows space for error. The inference isn't deductively watertight.
By contrast, in the case of arithmetical induction, we start not from a bunch of claims about particular numbers but from an already universally quantified claim about all numbers, i.e. $\forall \mathsf{x}(\varphi(\mathsf{x}) \to \varphi(\mathsf{Sx}))$ (where $\mathsf{Sx}$ is the successor of $\mathsf{x}$). We put that universal claim together with the particular claim $\varphi(0)$ to derive another universal claim, $\forall \mathsf{x}\varphi(\mathsf{x})$. This time, then, we are going from universal to universal, and there is no deductive gap.
You might say 'Pity, then, that we use the same word in talking of empirical induction and arithmetical induction when they are such different kinds of inference.' True enough!
Further help on induction - Daniel Velleman's quite terrific book How to Prove it.
Also some on-line exercises on induction, with detailed worked answers.