Suppose that $\mathbf{y=Ax}$ and that a probability density function over $\mathbf{x}$ is defined as $p(\mathbf{x})$.
If $\mathbf{A}$ has an inverse then the PDF over $\mathbf{y}$ is given by $q(\mathbf{y}) = \frac{1}{|\det \mathbf{A}|}p(\mathbf{A}^{-1}\mathbf{y})$
However if $\mathbf{x}$ has higher dimensionality than $\mathbf{y}$, so $\mathbf{A}$ is singular, then this doesn't work. So what then is the transformed PDF, $q(\mathbf{y})$? It seems to me that this PDF is still well defined, although some dimensions have been marginalized out.
I'm also interested in the independent case where $p(\mathbf{x}) = \prod_i \phi(x_i)$, which might simplify things.