In a book I am reading (Blank, Exner, Havlíček: Hilbert Space Operators in Quantum Mechanics), functions of operators are defined via spectral decomposition for self-adjoint operators. Spectral decomposition is also well-defined for unitary operators so I expect functions over these could also be defined analogously.
Then, however, throughout quantum mechanics, one often encounters exponentials of operators which are neither and not even normal, like the annihilation operator (with spectrum equal to $\mathbb{C}$) or the creation operator (whose spectrum is empty, AFAIK). This is usually understood in terms of the Taylor expansion,
$$\exp A = \sum_{n=0}^{+\infty} \frac1{n!} A^n$$
which in the relevant contexts turns out to be easy enough to apply term-wise when $\exp A$ acts on a vector. This is obviously a work-around with many dangerous pitfalls, keeping in mind that Taylor expansion does not work properly even in the "canonical" uses of exponential (take, for example,
$$\exp \left( a \frac{\mathrm{d}}{\mathrm{d}x} \right) f(x) \ne f(x+a)$$
for functions which are $C^\infty$ but not analytic).
My question is, is there a way of defining exponentiation rigorously for a broader class of operators? For example, if we know the spectrum and all eigenvectors of an operator, and those span the entire space (like the annihilation operator), would it be true to say its exponential is an operator with the same eigenvectors corresponding to $e$ raised to the respective eigenvalues? What would then happen in the case of the creation operator?