3k views

### Difference between Principal Component Analysis(PCA) and Singular Value Decomposition(SVD)? [duplicate]

Possible Duplicate: What is the intuitive relationship between SVD and PCA I am confused between PCA and SVD. The wikipedia page for the PCA has this line: "PCA can be done by eigenvalue ...
25k views

### What do eigenvalues have to do with pictures?

I am trying to write a program that will perform OCR on a mobile phone, and I recently encountered this article : Can someone explain this to me ?
119k views

### Best Fitting Plane given a Set of Points

Nothing more to explain. I just don't know how to find the best fitting plane given a set of $N$ points in a $3D$ space. I then have to write the corresponding algorithm. Thank you ;)
4k views

### Why is SVD on $X$ preferred to eigendecomposition of $XX^\top$ in PCA?

In this post J.M. has mentioned that ... In fact, using the SVD to perform PCA makes much better sense numerically than forming the covariance matrix to begin with, since the formation of $XX^\top$ ...
3k views

### Relationship between the singular value decomposition (SVD) and the principal component analysis (PCA). A radical result(?)

I was wondering if I could get a mathematical description of the relationship between the singular value decomposition (SVD) and the principal component analysis (PCA). To be more specific I have some ...
4k views

### compute pca with this useful trick

A is matrix (m rows, n cols), each row is an object, and each cols is a feature (a dimension). Typically, I compute the pca ...
1 vote
2k views

### Decomposing a matrix into lower dimension sub-components

Given a matrix $M^{n \times n}$, I would like to decompose it into two smaller matrices $A^{n \times m}$ and $B^{m \times n}$, with $m < n$ so that the multiplication of both $AB = M'$ ...
1 vote
2k views

### Best-fitting plane

I need to implement the algorithm described below. Everything is fine until the eigenvalues computation. I'm completely new to them and I found a lot of very complicated paper on the net. Is it ...
1 vote
685 views

### Principal Component Analysis - Eigen value decomposition or Singular value decomposition?

I have been reading various articles/papers on PCA and some of the authors mention it as a Eigen values whereas others go by singular values. From whetever remnants of Bachelor's algebra in my memory, ...
314 views

### What does singular value decomposition of covariance matrix represent?

I am reading the paper "Understanding dimensional collapse in contrastive self-supervised learning." The authors identified a dimensional collapse phenomenon: i.e. some dimension of ...
1 vote
224 views

### Equivalence of maximizing variance and sum-of-squares for a projection.

(The following is motivated by the singular value decomposition:) Say we have an N x D matrix $A$. The first principal component $v_1$ is the unit-length vector of dimension D which maximizes the ...
In this post, it is stated that In fact, using the SVD to perform PCA makes much better sense numerically than forming the covariance matrix to begin with, since the formation of $XX^\top$ can cause ... 