Ravichandran's answer is right: the natural numbers are the numbers 0, 1, 2, 3, ... . We can directly understand these numbers, based on our inductive definition of how to count in English or another natural language, even before we create an axiom system for them.
The standard list of axioms that we use to characterize the natural numbers was stated by Peano. Several people have brought up first-order logic in answers here, but that isn't what you want to use to establish categoricity (I will come back to that). Dedekind was the first to prove that we can axiomatize the natural numbers in a way that all models of our axioms are isomorphic, using second-order logic with second-order semantics.
Theorem (after Dedekind). Say that we have two structures $(A, 0_A, S_A)$ and $(B, 0_B,S_B)$ each of which is a model of Peano's axioms for the natural numbers with successor, and each of which has the property that every nonempy subset of the domain has a least element. Then there is a bijection $f\colon A \to B$ such that $f(0_A) = 0_B$ and for all $a \in A$ $f(S_A(a)) = S_B(f(a))$.
The theorem is proved using the axiom of induction repeatedly, but the idea is completely transparent. Suppose that Sisyphus is given a new task. He will count out all the natural numbers in order in Greek, while a fellow tortured soul will count out all the natural numbers in order in English, at the same speed as Sisyphus. Just based on Ravichandran's assessment of what the natural numbers are, the map that sends each number spoken by Sisyphus to the number spoken by his companion at the same time is obviously an isomorphism between the "Greek natural numbers" and the "English natural numbers."
This argument cannot be captured in first-order logic, not even in first-order ZFC. But that isn't the fault of the natural numbers: first order logic can't give a categorical set of axioms for any infinite structure. Dedekind's proof can be cast in ZFC in the sense that it shows that the models of Peano's axioms in a certain model of ZFC are all isomorphic to each other in that model. Moreover, ZFC is sound in the sense that the things it proves about the natural numbers are correct. But as long as we use first-order semantics for ZFC, it can't fully capture the natural numbers.
The key point of second order semantics is that "every nonempty subset" means every nonempty subset. If a structure $(A, 0_A, S_A)$ satisfies a certain finite set of axioms that are all true in $\mathbb{N}$, then $\mathbb{N}$ can be identified with an initial segment of $A$. In this case, if $A - \mathbb{N}$ is nonempty it will not have a least element, and so $A$ will not satisfy the second-order Peano axioms. Again, this argument cannot be completely captured in first-order logic because $\mathbb{N}$ cannot be fully captured.
Even if we think of Peano's axioms as only specifying an isomorphism class of structures, the situation is not like Noetherian rings, where there are many non-isomorphic examples. $\mathbb{N}$ is more like the finite field on two elements. The question of which model of the second-order Peano axioms is really the "natural numbers" is like the question of which isomorphic copy of $F_2$ is "really" $F_2$. It's a fine question for philosophers, but as mathematicians we have a perfectly good idea what $F_2$ is, up to isomorphism, and a good idea what $\mathbb{N}$ is, up to isomorphism. We also have axiom systems that let us prove things about these structures. $F_2$ is easier to apprehend because it's finite, but this only makes $\mathbb{N}$ more interesting.