My question is literally the title:
Show $y = \sum_{k=1}^\infty \frac{k^{k-1}}{k!} x^k$ satisfies $ye^{-y} = x$.
Here's a little motivation for the question. If you don't care about motivation, then ignore what follows!
Considering Erdos-Renyi random graphs, in the supercritical case $p = c/n$ with $c > 1$, and consider the size of the giant component. We can show (eg Grimmett, Probability on Graphs, Theorem 11.1) that the size is $\theta(p) n$, where $\theta(p) \equiv \theta(c)$ is the survival probability for a Poisson$(c)$ branching process ($p = c/n$), and this satisfies $$ 1 - \theta(c) = \frac{1}{c} \sum_{k=1}^\infty \frac{k^{k-1}}{k!} (ce^{-c})^k.$$ Moreover, one can also show (eg, Frieze-Karonski, Introduction to Random Graphs, Theorem 2.14) that $\theta(c) = 1 - c'/c$, where $c'$ is the conjugate of $c$, ie for $c>1$ it is the solution $c' < 1$ of $c'e^{-c'} = c e^{-c}$. Combining these two formulae, we obtain (cancelling the $1/c$ factor) $$ c' = \frac{1}{c} \sum_{k=1}^\infty \frac{k^{k-1}}{k!} (ce^{-c})^k.$$ In my general statement at the top, I've just let $y = c'$ and $x = ce^{-c}$ for notational convenience.
Try as I might, I haven't been able to come up with any way of justifying the equality, however -- other than, of course, proving the two results on the size of the giant separately, then equating. One would hope that there's a way of showing it directly -- after all, it's not exactly an ugly expression: after not very long it becomes basically geometric; I tried on Matlab and with $c = 3$ I get machine precision after only $40$ terms in the sum. (My PhD supervisor has had a look at it too, but she wasn't able to work it out either!)