What kind of transformation an upper triangular matrix represents Every matrix represents a linear transformation, but depending on characteristics of the matrix, the linear transformation it represents can be limited to a specific type. For example, an orthogonal matrix represents a rotation (and possibly a reflection). Is it something similar about triangular matrices? Do they represent any specific type of transformation?
(Actually a reference describing different geometric transformations and their corresponding transformation matrices would be great)
 A: For complex matrices, the Schur Theorem tells you that any matrix is unitarily equivalent to an upper triangular matrix. So, in a sense, all matrices are upper triangular.
Similarly, in the complex case, any nilpotent matrix can be represented by a strictly upper triangular matrix. So the strictly upper triangular matrices represent nilpotent matrices.
A: Remember that the columns of a matrix are the images of a basis under the linear map that the matrix represents. The simplest observation for a triangular matrix is that the image of the $n$-h basis vector is in the span of the first $n$ basis vectors. So, the first vector gets mapped to somewhere on the line it generates, the second vector gets mapped into the plane generated by the first two vectors, and so on.
A: What you say about orthogonal matrices is true for dimensions 2 and 3. In higher dimensions an orthogonal matrix need neither be a reflection nor a rotation.
(For example you can construct a $4\times4$ orthogonal matrix with two $2\times2$ orhtogonal matrices as diagonal blocks; both blocks could be reflections individually making the whole matrix of determinant 1; both could be rotations of different angles etc).
In dimension two a triangular matrix with 1's in the diagonal represents a shearing transformation (upper triangular means horizontal shear and lower triangular means vertical shear).
