Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I came across these two terms in a paper about Natural Language Processing.

So I looked both of them up on the net and couldn't understand a thing.

So far I think their a method of comparing two quantities that have some kind of relationship with each other.Their used to determine how strong that relationship is but I don't quite understand how they work.

Could someone explain this like I'm 5?

share|cite|improve this question
up vote 2 down vote accepted

Kendall Tau and Pearson product moment are two (among many) correlation measures that quantify how closely one variable "tracks" another.

If you get the concept of an outlier, data points that are far from most other points, then the question arises as to how to weigh the outliers.

Pearson correlation weighs the outliers quadratically: outliers are relatively important.

Kendall Tau is called a "robust" correlation because it's based on just looking at rank-order as opposed to metric information and weighs outliers far less.

What's the difference? Think of a bicycle race. If only the order in which racers finish matters, rather than the clock-times (ie, metric) then it doesn't matter how far apart the racers are spaced - hence the winner could win by 1 second an hour (ie, outlier) - but the rank orders will stay the same.

The above example is just for the sake of understanding - there is no actual correlation with anything (you'd have to introduce another variable, maybe the degree of doping?)

There are many different ways to correlate data (some, like mutual information, quite abstract), each having its own limitations but how they weigh the data is a key distinction among them.

Let me add since you mention NLP, that one measure of document distance is via vector space models where correlations between words reflect how close documents match, see for example Rehurek "Scalability of semantic analysis...", 2011.

share|cite|improve this answer
Dude... This is a really good answer +5 if I could – cjds Feb 6 '13 at 15:31
Thank you. What's your interest in NLP? – alancalvitti Feb 8 '13 at 23:26

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.