Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

What is the relation between a dimension and a component in a Gaussian Mixture Model? And what is the meaning of dimension and component? Thank you.

Please correct me if I'm wrong: my understanding is the observed data have many dimensions. Each dimension represents a feature/aspect of the collected data and has its own Gaussian distribution. I don't know where "component" fits into this picture and what it means.

share|improve this question
add comment

2 Answers 2

The dimension is simply the dimension of the data. If each data point is simply a scalar, the dimension is 1, if each sample is of the form $(x,y)$, the dimension is 2. The components are the number of independent Gaussians it is a mixture of. The dimension and number of components are not related to each other.

share|improve this answer
add comment

Each dimension represents a feature/aspect of the collected data and has its own Gaussian distribution.

Not exactly. When we speak of "a mixture of gaussians" each gaussian is a "component" of that mixture. But each one of those gaussians might be one-dimensional (only one feature) or multi-dimensional (several features). In the later case, we have for each component a single multidimensional gaussian variable which has a joint gaussian distribution: don't think each feature by itself is a gaussian variable (it is, but that's not enough).

For example, suppose we measure the weight and height (w,h) of the men and women who live in some town. Suppose that, for each population (men and women), $(w,h)$ follows a gaussian distribution. Then, for each population, the observed variable is a two-dimensional gaussian variable (two features). Now, the weight-height of all the people (mixture of men and women) will be the mixture of those (two dimensional) gaussians. Hence, we have here two dimensions (weight-height) and two components (men and women).

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.