Here's a very simple heuristic that gives some motivation for why $\zeta(k)$ appears. Fix a $k$ and let $P$ be the limiting probability that a tuple in $[1,x]^k$ is relatively prime. Then, when $x$ is large, about $P x^k$ of the tuples in $[1,x]^k$ have gcd equal to $1$. How many have gcd equal to $2$? Well, after dividing through by 2 we get a relatively prime tuple, but it lives in $[1,\frac{x}2]^k$. Well, $\frac{x}2$ is still pretty large so we should have about $P (\frac{x}2)^k$ of those. Likewise, about $P(\frac{x}3)^k$ tuples should have a gcd of $3$, and in general we'd predict $P(\frac{x}{d})^k$ tuples having gcd $d$.
Now, there are $x^k$ tuples in $[1,x]^k$ and each has a unique gcd $d$, and so by sorting tuples according to the value of $d$ we get the approximate equality:
$$x^k \approx Px^k + P(\frac{x}2)^k + P(\frac{x}3)^k + \cdots = Px^k \big( 1 + \frac1{2^k} + \frac1{3^k} + \frac1{4^k} + \cdots \big),$$
and there's your $\zeta(k)$: we get $P\zeta(k) \approx 1$, so that $P \approx 1/\zeta(k)$.
[Caveat: the reason this is only a heuristic is that as we start to take $d$ larger the box $[1,x/d]^k$ is getting smaller, making this approximation less accurate. But at the same time its contribution to the sum is getting smaller than smaller, which mitigates the loss of accuracy. These are not insurmountable problems but they are created to some extent by the fact that this is only a limiting probability and not a true probability as pointed out in the comments.]