For questions about correlation of two random variables. Use it with [tag: random-variables] and [tag: probability].

learn more… | top users | synonyms

0
votes
2answers
338 views

Step by step correlation calculation

I must understand how I can calculate the correlation for the following probability variables. ...
1
vote
2answers
257 views

Linear vs non-linear Correlation

How do i check that two random variables satisfy the requirements for computing correlation via Pearson or Spearman? If the data is non-linear/ non-Monotonic, are there other tests i could use to ...
2
votes
0answers
105 views

Correlation between an event and a time series

I have a time series, e.g. the daily number of visitors on my blog. I have a set of events of some class, like the days when I made a new posting. I want to measure the effect of a new posting on the ...
1
vote
3answers
777 views

Determinant of a N symmetric square matrix with diagonal 1

What is the determinant of a symmetric $n \times n$ matrix with all diagonals be 1 and all others are $\rho$ (yes correlation matrix)? Anyone can tell me a method to work it out elegantly? Thanks!
5
votes
2answers
609 views

Eigenvalue decomposition of block covariance matrix for Canonical Correlation Analysis (CCA)

Edited: My question is related to a tutorial I was reading. The covariance matrix is a block matrix where $C_{xx}$ and $C_{yy}$ are within-set covariance matrices and $C_{xy} = C_{yx}^T$ are ...
1
vote
1answer
125 views

Independence of quadratic forms

Let us consider the quadratic form $$q_1 = \mathbf{x}_1^\mathrm{H} \mathbf{A}\,\mathbf{x}_1 $$ and the quadratic form $$ q_2= \mathbf{x}_2^\mathrm{H} \mathbf{A}\, \mathbf{x}_2 $$ where ...
0
votes
3answers
165 views

Prove dot product will get maximum

If we have two identical sets $A_1 = A_2 $, and we were asked to get the maximum sum of multiplying one distinct element from $A_1$ by another distinct element of $A_2$, for all elements in $A_1$. ...
2
votes
0answers
165 views

Correlated diffusion processes and covariance matrix

I'm really noob in maths topics so I hope you will excuse me if I use terms which aren't correct. I would like to simulate $n$ dimensional diffusion processes with $n$ noises. Each process has its ...
3
votes
2answers
212 views

Correlation and squared variables

According to my textbooks if two variables are uncorrelated, they are not necessarily independent (unless they are normally distributed). My question is, are 2 variables still not independent if they ...
4
votes
1answer
68 views

PCA vs Correlation

What is the relationship between (first) principal component(s) and the correlation matrix or the average correlation of the data. For example, in an empirical application I observe that the average ...
0
votes
1answer
224 views

Difference between positively correlated graph and a linear relationship?

So I understand the differences between positive and negative correlation and so on. However what I don't understand are the similarities and differences between a positive correlation and a linear ...
2
votes
3answers
88 views

Product of standard deviations

If $u=cx+dy$ and $v=cx-dy$ and $R$ is the co-efficient of correlation between variables $x$ and $y$ and variables $u$ and $v$ have 0 correlation, then how can I prove that ...
2
votes
1answer
523 views

Calculate a whitening matrix without using inverses?

Consider a random column vector $\mathbf{x}$, of dimension $m$. That is, it is a random vector, composed of $m$ random variables. The PDF of the random vector $\mathbf{x}$ is thus the joint-PDF of its ...
2
votes
1answer
91 views

Nonlinear regression with correlated errors

it's my first post here and I'm a newbie in statistics, so please forgive me if I'm doing something wrong or explaining myself badly. Anyway, I have a problem similar to this: How to perform ...
3
votes
0answers
135 views

How to perform nonlinear regression with correlated errors?

I have a nonlinear least squares problem, but the errors are correlated. I could use R's nls function to do the regression if the errors were independent, but I don't know the right way to handle ...
1
vote
0answers
116 views

Windowed Linear Correlation

$\DeclareMathOperator \Cov {Cov}$ $\DeclareMathOperator \Var {Var}$ $\DeclareMathOperator \E {E}$ Consider the following experiment: For $N\geq1$, consider $N$ black balls. Let us paint each black ...
3
votes
1answer
411 views

Necessary and sufficient conditions for a matrix to be a valid correlation matrix.

It's not too hard to see that any correlation matrix must have certain properties, such as all entries in the range -1 to 1, symmetric, positive semi-definite (excluding pathological cases like ...
4
votes
2answers
136 views

Correlation in errors

I'm not good in statistics, so please excuse my noob question. We want to ask a question from people (say what is $2+2$). They might make mistake. We assume that they give the correct answer with the ...
1
vote
1answer
262 views

Pearson Product Moment Correlation Coefficient for linear relationship only?

Pearson Product Moment Correlation Coefficient method is used only if variables are linearly correlated. But if they are linearly correlated, then correlation coefficient $$r=\pm 1$$ only. Then why we ...
8
votes
1answer
9k views

Generating correlated random numbers: Why does Cholesky decomposition work?

Let's say I want to generate correlated random variables. I understand that I can use Cholesky decomposition of the correlation matrix to obtain the correlated values. If $C$ is the correlation ...
3
votes
2answers
123 views

Proving that the magnitude of the sample correlation coefficient is at most $1$

How can you show that the magnitude of the sample correlation coefficient is at most $1$? The formula is huge, I'm not even sure how to approach this. Can anyone point me in the right direction? ...
0
votes
0answers
33 views

Fast approximate construction of orthogonal system

Assuming I have $d+1\in\mathbb{R}^d$ points that are not unfortunately chosen (in which case I can just resample, correct me if I $d$ points are enough), then these should span the whole space. What ...
1
vote
0answers
29 views

Dynamic Light Scattering

In DLS does the combination of the Time Average and Ensemble Average give a better statistical average than the results shown by each case considered separately ?
1
vote
1answer
675 views

Probability that one normal distribution is greater than the other when they are correlated i.e (Not Independent)

Would like to know how to approach this question: Probability that one normal distribution is greater than the other when they are correlated i.e (Not Independent). Seen the solution for the ...
0
votes
1answer
57 views

What is a common way to measure the “goodness of fit” of an individual data point to a correlation?

Let's say I have a collection of data points (X & Y values) that show some correlation when, eg, Pearson's correlation formula is applied. What is a good measure for determining which data points ...
1
vote
1answer
342 views

Correlation Coefficients with Unequal Data Sets

I would like to determine the correlation coefficients of two timesets of data with unequal entries to detemine how often they move together. I am performing the following computation but would like ...
2
votes
2answers
2k views

Correlations between 3 random variables

I have a question as follows: The correlation coefficients between three random variables are x, y, and z respectively. What relation do x, y, and z have to satisfy? Can someone help me? Thanks very ...
2
votes
1answer
64 views

Given series $A$ and a correlation, is it possible to randomly calculate a fitting series $B$?

With reference to the original thread on Stackexchange, my question is as follows. Usually, one would enter two value-series and a script or program calculates the correlation. For instance, with $x ...
0
votes
0answers
266 views

How to find a correlation and whether it is statistically significant

I have 2 columns with numers in them, x and y. I'd like to find out what y could be if x = n and how strong the correlation is, if it's statistically significant or not. How do I do that? Pretty ...
0
votes
1answer
308 views

MATLAB's implementation of cross correlation

Wikipedia gives the cross-correlation as $$ \begin{align*} (f \star g)[n] = \sum^{\infty}_{m = -\infty} f^{*}[m] g[n+m] \end{align*} $$ MATLAB's documentation gives ...
5
votes
2answers
2k views

Correlation Coefficient and Determination Coefficient

I'm really new to linear regression and am trying to teach myself. In my textbook there's a problem that asks why R^2 in the regression of Y on X = the sample correlation between X and Y the whole ...
2
votes
1answer
86 views

constructing “pseudonoise” sequences other than (2^n)-1? (low cyclical autocorrelation)

Pseudonoise LFSR sequences of length $N = 2^k-1$ have the nice property that their cyclical autocorrelation is $N$ when the sequence is lined up with itself, and $-1$ elsewhere. Is there a way to ...
3
votes
2answers
97 views

Independence of Random Variables (kernel ICA)

In the paper Bach, F. R., & Jordan, M. I. (2002). Kernel Independent Component Analysis. Journal of Machine Learning Research, 3(1), 1-48. doi:10.1162/153244303768966085 I stumpled upon ...
0
votes
0answers
822 views

Pseudo-random binary sequence generated by shift register

Binary sequence generated by shift register with feedback have periodic properties. A simple 4-bit shift register shown in Fig (a). For the initial condition shown, it can be verified that the ...
3
votes
3answers
3k views

Correlation between two linear sums of random variables

I understand how to create random variables with a prespecified correlational structure using a Cholsesky decomposition. But I would like to be able to solve the inverse problem: Given random ...
0
votes
0answers
49 views

Finding out whether or not two graphs are “close”, given 20 points on each graph whose Xs do not match

Let's assume we have two graphs where: Each graph has 600 points per minute. We're allowed to get only one point per minute. We do not get the same point per minute in both graphs. So for example, ...
1
vote
2answers
394 views

Error of Pearson Correlation Coefficient

I have a data set expressed as in the figure here. 'y' is some measured quantity with known error and 'fit' is some attempt to fit a function with zero error. In order to evaluate the quality of the ...
1
vote
0answers
172 views

Cross Correlation

The cross-correlation function is defined as follows if $\bar{f}$ is the complex conjugate of $f$ and we assume that $f$ is real, such that $\bar{f} = f$. $$ \begin{align} f \star g &= ...
1
vote
1answer
125 views

In search of memorable example of “(Pearson-)uncorrelated $\not\Rightarrow$ independent”

I am looking for an easy-to-remember (and non-trivial) example that vividly illustrates that the "uncorrelatedness" (in the sense of Pearson) of two random variables $X, Y$ does not imply that $X$ and ...
0
votes
1answer
104 views

Find 3 normal variables which are linear combinations based on 3 ind std normal variable given a correlation matrix

I am given $3$ normal random variables $X_1$,$X_2$,$X_3$ which are linear combinations of $Z_1$,$Z_2$,$Z_3$. $Z_1$,$Z_2$,$Z_3$ are mutually independent standard normal variables. I am given a ...
2
votes
1answer
129 views

Given $Z_1$ and $Z_2$ independent normal variables, find a pair $X_1,X_2$ with correlation $p$

I am given $Z_1$ and $Z_2$ independent standard normal variables, I have to find two random variables $X_1$ and $X_2$ with correlation $\operatorname{corr}(X_1,X_2) = p$, where $p\in (−1, 1)$. Any ...
0
votes
1answer
252 views

Calculate Upper Lower bound in $4\times 4$ correlation matrix

Let $X_i$, $i = 1,2,3 4$, be random variables on the same probability space such that $$\begin{align*} \mathrm{corr}(X_1,X_3) &= 0.3;\\ \mathrm{corr}(X_2,X_3) &= 0.1;\\ ...
-2
votes
2answers
167 views

Autocovariances and Autocorrelations of Processes

I have two questions that are related to calculating autocovariances and autocorrelations of processes. Let's say we have a simple process: $y_t = ε_t + ε_{t-1}$ $ε_{t} =$ standard normal random ...
2
votes
0answers
226 views

Geometric interpretation of element by element division of one vector by another

This is my first post here, and I'm not a mathematician, so please go easy on me :) In statistics there is a geometric interpretation of correlation that uses basic vector geometry. This is fairly ...
6
votes
2answers
20k views

Determining variance from sum of two random correlated variables

I understand that the variance of the sum of two independent normally distributed random variables is the sum of the variances, but how does this change when the two random variables are correlated? ...
3
votes
3answers
524 views

Correlation between variables

I asked this question on stats SE but did not find a suitable answer so far. Maybe someone can help. Given n random variables x1,...,xn (one-dimensional). The following is known (corr() = Pearson ...
1
vote
2answers
62 views

Relationship between x and y

Studying a financial model from a third party we see: 36month - 1.2 multipler 48month - 1.3333 multipler 60month - 1.5 multipler I am trying to determine if ...
3
votes
1answer
328 views

Use Pearson's correlation coefficient on a matrix

I have a problem to interpret the following formula which is said to be the Pearson's correlation coefficient: $$r = \frac{N \left(\sum XY\right) - \left(\sum X\right) \left(\sum ...
1
vote
2answers
2k views

If two Gaussian random variables are uncorrelated, they are statistically independent

I read in a textbook that when two gaussian variables are uncorrelated, then they are statistically independent? How can I prove that?
1
vote
0answers
46 views

Sampling a distribution with restrictions: eliminating the correlation between two variables

I have a collection of 400.000+ word-pairs. Each word-pair has an association strength, which is a measure of how related the two words are to each other (as in cow-milk). Each word-pair also has a ...