Do we get predicative ordinals above $\Gamma_0$ if we use hyperexponentiation? I am trying to understand the Veblen hierarchy but I still find it confusing. 
The Feferman–Schütte ordinal, $\Gamma_0$, can be described as the set of all ordinals that can be written as finite expressions, starting from zero, using only the Veblen hierarchy and addition. The Veblen hierarchy starts with the function $\omega^\alpha$ and uses recursion to generate larger and larger functions. 
But I am not sure why we start with $f(\alpha)=\omega^\alpha$, or why we restrict the definition of $\Gamma_0$ to Veblen hierarchy and addition. Would we  obtain recursive ordinals larger than $\Gamma_0$ if we start the hierarchy with some faster growing function? For instance we can use hyperoperators to define  $f(\alpha)=(\alpha\uparrow ^\alpha \alpha)^{(\alpha)}$ (where the upperscript $(\alpha)$ means $\alpha$-times composition) which is immensely huge. We could also include this new hierarchy plus addition and any hyperoperator to define the limit $\Gamma_0$. But it is not clear to me if doing it this way results in the same $\Gamma_0$, or in a larger (but still predicative?) one.
 A: This is mostly a more extended version of my comment. As for a book or published paper where $\Gamma_0$ is carefully and rigorously obtained, probably the best I know of is:
Wolfram Pohlers, Proof Theory. The First Step into Impredicativity, 2008.
However, the audience and goals of Pohlers' book are quite distant (in my opinion) from the basic ideas behind normal functions on ordinals and fixed-points of normal functions, which I think have not had enough exposition about in the mathematical literature. For example, pick up any of the dozens of introductory set theory books and many more related books (in real analysis, topology, etc.) in which ordinals are discussed, and you'll see nearly identical discussions of how the countable ordinals include $\epsilon_0$ and beyond (but no author seems to vary on this and indicate, even if briefly, some of the interesting things that lie in the "and beyond" realm), and if you pick up any of the more advanced books and papers in set theory and in proof theory where large countable ordinals are discussed, you're in for a whirlwind ride in which $\epsilon_0$ and $\Gamma_0$ are barely mentioned as bacteria on a microscope slide in the quest to reach the distant quasars of ever more exotic recursive ordinal notations, which are cryptically pitched to an audience of a few specialists. There seem to be no middle-ground expositions of this topic.
Maybe A short introduction to Ordinal Notations by Harold Simmons comes close to being a middle-ground exposition.
However, I think much better is the following, which is not written with applications of large ordinals to proof theory as its end goal. Instead, the focus is on the ride up through the ordinals.
John Baez, This Week's Finds in Mathematical Physics (Week 236; 26 July 2006)
Also, look up diagonal intersection. I believe this is the operation that takes you from ordinals defined via the $\alpha$'th order hyper-operation (applied to $\beta$) to $\Gamma_{0}.$
Finally, below are some things I've posted elsewhere that may be of use. Incidentally, I never continued the treatment of ordinal numbers I began in the first post below, as I wound up getting busy at work. I also started to think that it wasn't such a good idea to spend so much time preparing ASCII expositions of things that I had planned to write up more formally in LaTeX and distribute in some manner (publication, math arXiv site, or perhaps just toss out like I did with this).
Renfro, ORDINAL NUMBERS #1, sci.math, 29 October 2006. [Last version of this essay. See the discussion at the end concerning ${\omega}^{\omega}$ being simultaneously the ${\omega}^{\omega}$'th ordinal and the ${\omega}^{\omega}$'th limit ordinal.]
Renfro, Transfinite Aleph and Beth ordinal sequences, sci.math, 23 November 2003.
Renfro, fixed points with ordinal maps, sci.math, 30 November 2008. [See also the follow-up on 2 December 2008.]
