For questions about correlation of two random variables. Use it with [tag: random-variables] and [tag: probability].

learn more… | top users | synonyms

8
votes
1answer
10k views

Generating correlated random numbers: Why does Cholesky decomposition work?

Let's say I want to generate correlated random variables. I understand that I can use Cholesky decomposition of the correlation matrix to obtain the correlated values. If $C$ is the correlation ...
6
votes
2answers
23k views

Determining variance from sum of two random correlated variables

I understand that the variance of the sum of two independent normally distributed random variables is the sum of the variances, but how does this change when the two random variables are correlated? ...
6
votes
1answer
163 views

Correlations between neighboring Voronoi cells

For a sequence $X_1,X_2,X_3,\ldots$ of random variables, what it means to say $X_1$ is correlated with $X_2$ is unambiguous. It may be that the bigger $X_1$ is, the bigger $X_2$ is likely to be. If, ...
6
votes
4answers
884 views

Going back from a correlation matrix to the original matrix

I have N sensors which are been sampled M times, so I have an N by M readout matrix. If I want to know the relation and dependencies of these sensors simplest thing is to do a Pearson's correlation ...
5
votes
1answer
5k views

Generate Correlated Normal Random Variables

This will be a difficult question to explain, but I'll give it my best. I'm running a simulation with a group of objects (let's just call them agents) and each agent has $n$ parameters that defines ...
5
votes
1answer
488 views

Asymptotic correlation between sample mean and sample median

Suppose $X_1,X_2,\cdots$ are i.i.d. $N(\mu,1)$. Show that the asymptotic correlation between sample mean and sample median (after suitably centering and renormalization) is $\sqrt{\frac{2}{\pi}}$.
5
votes
2answers
675 views

Eigenvalue decomposition of block covariance matrix for Canonical Correlation Analysis (CCA)

Edited: My question is related to a tutorial I was reading. The covariance matrix is a block matrix where $C_{xx}$ and $C_{yy}$ are within-set covariance matrices and $C_{xy} = C_{yx}^T$ are ...
5
votes
1answer
158 views

Find $\operatorname{argmax}_x \operatorname{corr}(Ax, Bx)$ for vector $x$, matrices $A$ and $B$

This is similar to, but not the same as, canonical correlation: For $(n \times m)$ matrices $A$ and $B$, and unit vector $(m \times 1)$ $x$, is there a closed-form solution to maximize the correlation ...
5
votes
1answer
122 views

Weighing correlation by sample size

I'm a scholar in the humanities trying to not be a complete idiot about statistics. I have a problem relevant to some philological articles I'm writing. To avoid introducing the obscure technicalities ...
5
votes
3answers
2k views

Correlation Coefficient and Determination Coefficient

I'm really new to linear regression and am trying to teach myself. In my textbook there's a problem that asks why R^2 in the regression of Y on X = the sample correlation between X and Y the whole ...
4
votes
1answer
273 views

Covariance, covariance operator, and covariance function

I am trying to get my head wrapped around this article in Wikipedia. The first definition given there is the covariance of a probability measure $\mathbf{P}$: $$\mathrm{Cov}(x, y) = \int_{H} \langle ...
4
votes
3answers
918 views

Bounds on off-diagonal entries of a correlation matrix

Assume that all the entries of an $n \times n$ correlation matrix which are not on the main diagonal are equal to $q$. Find upper and lower bounds on the possible values of $q$. I know that the ...
4
votes
1answer
161 views

Mean density of the nontrivial zeros of the Riemann zeta function

As part of my MSc I am reviewing a paper. The paper is a review on the statistical distribution of the unfolded zeros (see below) of the Reimann functional equation. In the paper there is a sentence: ...
4
votes
1answer
69 views

PCA vs Correlation

What is the relationship between (first) principal component(s) and the correlation matrix or the average correlation of the data. For example, in an empirical application I observe that the average ...
4
votes
2answers
144 views

Correlation in errors

I'm not good in statistics, so please excuse my noob question. We want to ask a question from people (say what is $2+2$). They might make mistake. We assume that they give the correct answer with the ...
3
votes
3answers
612 views

Is correlation (in some sense) transitive?

If we know that A has some correlation with B ($\rho_{AB}$), and that B has some with C ($\rho_{BC}$), is there something we know to say about the correlation between A and C ($\rho_{AC}$)? Thanks.
3
votes
4answers
5k views

Correlation between three variables question

I was asked this question regarding correlation recently, and although it seems intuitive, I still haven't worked out the answer satisfactorily. I hope you can help me out with this seemingly simple ...
3
votes
2answers
101 views

Independence of Random Variables (kernel ICA)

In the paper Bach, F. R., & Jordan, M. I. (2002). Kernel Independent Component Analysis. Journal of Machine Learning Research, 3(1), 1-48. doi:10.1162/153244303768966085 I stumpled upon ...
3
votes
3answers
561 views

Correlation between variables

I asked this question on stats SE but did not find a suitable answer so far. Maybe someone can help. Given n random variables x1,...,xn (one-dimensional). The following is known (corr() = Pearson ...
3
votes
1answer
478 views

Necessary and sufficient conditions for a matrix to be a valid correlation matrix.

It's not too hard to see that any correlation matrix must have certain properties, such as all entries in the range -1 to 1, symmetric, positive semi-definite (excluding pathological cases like ...
3
votes
3answers
3k views

Correlation between two linear sums of random variables

I understand how to create random variables with a prespecified correlational structure using a Cholsesky decomposition. But I would like to be able to solve the inverse problem: Given random ...
3
votes
2answers
99 views

Covariance$(X,Y) \geq 0$ if $X,Y \geq 0$?

I was wondering if you can say something about the covariance of two positive variables $X$ and $Y$?
3
votes
2answers
138 views

Proving that the magnitude of the sample correlation coefficient is at most $1$

How can you show that the magnitude of the sample correlation coefficient is at most $1$? The formula is huge, I'm not even sure how to approach this. Can anyone point me in the right direction? ...
3
votes
2answers
234 views

Correlation and squared variables

According to my textbooks if two variables are uncorrelated, they are not necessarily independent (unless they are normally distributed). My question is, are 2 variables still not independent if they ...
3
votes
1answer
1k views

quadratic relationship

Detection of linear relationship is possible with correlation coefficient. If absolute value of correlation coefficient is 1, then the relationship is linear. Is there any way for detecting quadratic ...
3
votes
1answer
142 views

Autocorrelation of wrapped Wiener process

Let $\phi(t)$ be a Brownian Walk (Wiener Process), where $\phi\in[0,2\pi)$. As such we work with the variable $z(t)=e^{i\phi(t)}$. I would like to calculate $$E(z(t)z(t+\tau)).$$ This is equal to ...
3
votes
1answer
51 views

finding the unspecified ${\bf E}[X]$ and $\rm var(X)$ given the expectation of higher powers of $X$

Homework Problem: It is known that a for a standard normal random variable $X$, we have ${\bf E}[X^3]=0$, ${\bf E}[X^4]=3$, ${\bf E}[X^5]=0$, ${\bf E}[X^6]=15$. Find the correlation coefficient ...
3
votes
1answer
347 views

Use Pearson's correlation coefficient on a matrix

I have a problem to interpret the following formula which is said to be the Pearson's correlation coefficient: $$r = \frac{N \left(\sum XY\right) - \left(\sum X\right) \left(\sum ...
3
votes
3answers
206 views

Using Correlation for mouse gesture recognition

I am in need to build a mouse gesture recognition system which will compare given recognition to the the gestures in training data and will say where a given gesture best fits. I am planning to use ...
3
votes
0answers
140 views

How to perform nonlinear regression with correlated errors?

I have a nonlinear least squares problem, but the errors are correlated. I could use R's nls function to do the regression if the errors were independent, but I don't know the right way to handle ...
3
votes
0answers
857 views

Correlation and Regression Question

Two separate tests are designed to measure a students ability to solve problems. Several students are randomly selected to take both tests and the results are: $$ \begin{matrix} \text{Test A}(x) ...
2
votes
2answers
8k views

Calculating the variance of the ratio of random variables

I want to calculate $\newcommand{\var}{\mathrm{var}}\var(X/Y)$. I know that the solution is $$\var(X) + \var(Y) - 2 \var(X) \var(Y) \mathrm{corr}(X,Y) \>,$$ but, how do I derive it from "common" ...
2
votes
3answers
89 views

Product of standard deviations

If $u=cx+dy$ and $v=cx-dy$ and $R$ is the co-efficient of correlation between variables $x$ and $y$ and variables $u$ and $v$ have 0 correlation, then how can I prove that ...
2
votes
1answer
65 views

Given series $A$ and a correlation, is it possible to randomly calculate a fitting series $B$?

With reference to the original thread on Stackexchange, my question is as follows. Usually, one would enter two value-series and a script or program calculates the correlation. For instance, with $x ...
2
votes
1answer
22 views

Comparing ranking algorithms

If I have several different ranking algorithms and a 'correct' ranking, is there a good way of "scoring" the alternative rankings given by the algorithms against the reference one? For example: ...
2
votes
1answer
40 views

$\rho_\gamma(X)=\frac{1}{\gamma} \log \mathbb{E}[e^{-\gamma X}]$

$\rho_\gamma(X)=\frac{1}{\gamma} \log \mathbb{E}[e^{-\gamma X}]$ is a convex risk measure, but it fails the subadditivity property in order to be called coherent. A mapping ...
2
votes
2answers
236 views

Relationship between variances in perfect correlation

I have two random variables $X$ and $Y$ with mean and standard deviation $(\mu_1,\sigma_1)$ and $(\mu_2,\sigma_2)$ respectively. I know that for perfect correlation the relationship is given by a ...
2
votes
2answers
179 views

Calculating the correlation between subsequent values in a stream of numbers

I have a stream of integer values being generated $V_1,\cdots, V_n$ and want to calculate how the value of $V_{n+1}$ is correlated to $V_n.$ I would also like to calculate this at run time as ...
2
votes
1answer
368 views

Maximum and minimum Correlation Coefficient

I have a question regarding the correlation coefficient. The inspiration is from a story where a student collected a set of $(X,Y)$ pairs, but lost the pairings. Hence, he is left with two sets of ...
2
votes
1answer
86 views

Find data to perform regression analysis

I'm trying to find some data (two continuous variables that I believe are correlated) online for which I can perform a regression anaylsis, my assignment sheet says: The data may be found anywhere ...
2
votes
1answer
580 views

Calculate a whitening matrix without using inverses?

Consider a random column vector $\mathbf{x}$, of dimension $m$. That is, it is a random vector, composed of $m$ random variables. The PDF of the random vector $\mathbf{x}$ is thus the joint-PDF of its ...
2
votes
1answer
87 views

constructing “pseudonoise” sequences other than (2^n)-1? (low cyclical autocorrelation)

Pseudonoise LFSR sequences of length $N = 2^k-1$ have the nice property that their cyclical autocorrelation is $N$ when the sequence is lined up with itself, and $-1$ elsewhere. Is there a way to ...
2
votes
1answer
136 views

Given $Z_1$ and $Z_2$ independent normal variables, find a pair $X_1,X_2$ with correlation $p$

I am given $Z_1$ and $Z_2$ independent standard normal variables, I have to find two random variables $X_1$ and $X_2$ with correlation $\operatorname{corr}(X_1,X_2) = p$, where $p\in (−1, 1)$. Any ...
2
votes
1answer
3k views

What is the standard deviation of multiple correlated random variables subtracted from another random variable?

Wiki states that standard deviation of $X-Y$ is: $$\sigma_{x-y} = \sqrt { \sigma_x^2 + \sigma_y^2 - 2\rho\sigma_x\sigma_y }$$ I have a number (say 3) correlated random variables to be subtracted ...
2
votes
2answers
951 views

How to 'minimize' correlation between series

Hi fellow mathemagicians, let's say that I have 3 series of numerical results (they represent 'drawdowns') : ...
2
votes
1answer
20 views

Is $d(i,j) = 1-\textrm{corr}(i,j)$ a metric?

I need to make sure that this function is a metric: $d(i,j) = 1-\textrm{corr}(i,j)$ where $\textrm{corr}(x,y)$ is the Pearson correlation coefficient which ranges from $[-1,1]$. With this scaling I ...
2
votes
1answer
53 views

probability need help on correlation problem [duplicate]

A deck of 52 cards is shuffled you are dealt 13 cards. Let $X$ and $Y$ denote, respectively, the number of aces and the number of spades in your hand. Show that $X$ and $Y$ are uncorrelated. I try to ...
2
votes
2answers
111 views

Given X and Y are correlated and Y and Z are correlated what is the range of correlation between X and Z?

How can I calculate the range of correlation of two variables X and Z given I have the correlations of X and Y, and Y and Z? I've found a few resources around, namely this, but I'd like a research ...
2
votes
1answer
658 views

help understanding step in derivation of correlation coefficient

I'm looking to understand the starred step in the derivation below (also, if someone could help with the LaTex alignment, I'd appreciate it). The regression line is $y= b_0 + b_1 x$, where $b_0$ and ...
2
votes
1answer
67 views

How can I mathematically show the similarity between these 3 plots?

I have 3 3D plots of field strength measured around an antenna. I want to calculate the mathematical similarity between the points of the field patterns. How can I do this? thanks