For questions about correlation of two random variables. Use it with [tag: random-variables] and [tag: probability].

learn more… | top users | synonyms

3
votes
0answers
24 views

Detecting camera shake

I have a bunch of data captured from a worm tracker that consists of a B&W camera that stares down at a few dozen worms for an hour at a time. The tracker captures the outline of each worm ...
3
votes
0answers
162 views

How to perform nonlinear regression with correlated errors?

I have a nonlinear least squares problem, but the errors are correlated. I could use R's nls function to do the regression if the errors were independent, but I don't know the right way to handle ...
3
votes
0answers
1k views

Correlation and Regression Question

Two separate tests are designed to measure a students ability to solve problems. Several students are randomly selected to take both tests and the results are: $$ \begin{matrix} \text{Test A}(x) ...
2
votes
0answers
38 views

Calculate mean and correlation of a stochastic process

I am given the Stochastic process $Y_n$, where $n \in Z$ defined by: $ Y_n = X_n - X_{n-1}$ where $X_n$ is a process with independent and identically distributed geometric variables $X_n \sim G(p)$ ...
2
votes
0answers
35 views

Best line fit for correlated points

Given in $\mathbb{R}^3$ are $n$ points $\mathbf{y}_i\sim N(\mathbf{y}_i-\mathbf{\hat{y}}_i, \mathbf{C}_i)$, which are normally distributed. I want to determine a best fit line $\mathbf{u}(\lambda) = ...
2
votes
0answers
144 views

Expectation and convolution question.

I am learning in an image processing course, and the professor did the following: As part of a derivation, has this: What I do not understand, is how he was able to remove $r(i,j)$ to the ...
2
votes
0answers
29 views

correlation estimator

Suppose I have independent variables $X$ and $Y$ which follows exponential distribution with parameter $\lambda$. I want to find the variance of correlation estimator $\hat{\rho}$ which is defined as: ...
2
votes
0answers
72 views

Show that a function is log supermodular

I have been struggling with the following Let $X$ be finite and a poset $P = (X, \leq)$, and for any $A \subseteq X$ we can define the function $f_A$ on $\mathcal{P}(A)$ as follows $$ f_A(Y) = \#\{ ...
2
votes
0answers
36 views

Autocorrelation Clarification

Could anyone help clarify a high level explanation of autocorrelation? I understand that it is a measure of correlation between a timeseries and a lagged version of the same series. If we have take ...
2
votes
0answers
90 views

Expectation of random variables

a) Show that $E\{X-E(X)\} = 0$ for any random variable $X$. b) Use the result in part (a) and the following equation to show that if two random variables are independent then they are uncorrelated, If ...
2
votes
0answers
77 views

When does convergence in distributions inply convergence in covariance?

Good Morning. Let $(X_n)_n$ and $(Y_n)_n$ be sequences of random variables converging in distribution respectively to $X$ e $Y$. Suppose $X_n,Y_n$ are equally distributed but dependent for all $n$, ...
2
votes
0answers
57 views

A vector with fixed correlation with existing vector, is it always possible?

Suppose we have a known vector $X$ in $R^n$, and for any vector $Y$ in $R^n$, we impose on it the restriction that it must have a fixed correlation coefficient $r$ with $X$: \begin{align*} ...
2
votes
0answers
36 views

Finding correlations between many unknown functions.

Given an arbitrarily large number of black-box functions of one variable, is it possible to produce expressions that approximate their relationships to each other over their shared domain? Is it ...
2
votes
0answers
63 views

Dimension free Concentration bounds for Martingales

Consider the following random process which is defined on $n$ numbers $0\leq x_1,\ldots,x_n\leq 1$: At each step, pick an arbitrary number, say $x_i$. Then randomly (and independently) change its ...
2
votes
0answers
114 views

Finding the empirical correlation from a covariance matrix

I have this covariance matrix with five variables $X_1$ through $X_5$ in that order. ...
2
votes
0answers
1k views

What do angle brackets ($\langle\rangle$ ) mean in mathematics/statistics (autocorrelations)?

Okay, so the logarithmic return on a stock is given by: $$r_τ (t) = \ln P(t+τ) - \ln P(t),$$ where τ is the interval of time. I have no problem calculating that. My question comes to the following ...
2
votes
0answers
501 views

Pearson correlation and metric properties

Assuming that the data set was $z$-standardized to zero mean and unit variance (also assuming that it does not contain constant vectors). Then Pearson's r reduces to Covariance: $$\rho(X,Y) := ...
2
votes
0answers
133 views

Correlation between an event and a time series

I have a time series, e.g. the daily number of visitors on my blog. I have a set of events of some class, like the days when I made a new posting. I want to measure the effect of a new posting on the ...
2
votes
0answers
237 views

Correlated diffusion processes and covariance matrix

I'm really noob in maths topics so I hope you will excuse me if I use terms which aren't correct. I would like to simulate $n$ dimensional diffusion processes with $n$ noises. Each process has its ...
2
votes
0answers
243 views

Geometric interpretation of element by element division of one vector by another

This is my first post here, and I'm not a mathematician, so please go easy on me :) In statistics there is a geometric interpretation of correlation that uses basic vector geometry. This is fairly ...
1
vote
0answers
12 views

How to find covariance matrix from correlation if mean is not given?

I'm given autocorrelation function of gaussian random process: $$ R_x(\tau) = 3e^{|-\tau/3|} $$ Now I should find covariance matrix. I know the formula and solutions, where $$ C_{xx} = R - E[X]E[Y] $$ ...
1
vote
0answers
28 views

Limit of correlation function using transfer-matrix method

This question is about a stochastic process theory. I really very bad in this topic. That's why I have to ask for help. I may mistranslate some terms but I'll do my best to give you right information. ...
1
vote
0answers
48 views

Minimize correlation between input and output of a linear system

I am not sure if "minimize correlation" is the right title for this issue but I could not find a better sentence to describe what I would like to achieve. Let's say that I have a black box with ...
1
vote
0answers
12 views

Question about the relationship between correlations

I am trying to figure out the relationship between correlations of variables where one of the variables defined as the difference between two other variables. I have variables x and z, which are ...
1
vote
0answers
25 views

How to convert principal components of a $2\times2$ covariance matrix into principal components of a correlation matrix

All, I am wondering if there is any way to mathematically express the change in direction of the principal components from the $2\times2$ covariance matrix to the correlation matrix. In other words, ...
1
vote
0answers
35 views

Data analysis: How did people beat the Great Hall game?

This is the game: There is a Great Hall with 102 doors. 100 of these doors lead to one of 100 different side rooms. The 101st door, at the end of the Great Hall leads to the Great Tower, where ...
1
vote
0answers
12 views

Is there any reason that cross correlation would perform well or poorly on sparse binary arrays?

I am using matlabs xcorr to correlate simulated photon count data that has some Gaussian random noise set on top of it and it is working fine when the average value in the arrays is greater than one ...
1
vote
0answers
20 views

FFT of k*k matrix from FFT of a j*j matrix

FFT of matrix a j by j matrix, A $\begin{bmatrix}1 & 2\\3 & 4\end{bmatrix}$ = $\begin{bmatrix}10 & -2\\-4 & ...
1
vote
0answers
41 views

Increase the probability of correct prediction using multiple regression

First off let me begin by saying that I'm brand new to statistics and I would appreciate it if you could dumb down any answers for my problem. I am trying to create a general prediction of how much a ...
1
vote
0answers
46 views

Correlation Matrix using Matrix Algebra, not the Same as Result from Excel

I am attempting to verify a calculation found at another question on this site. The formula is said to provide a correlation matrix using q = D-1ED-1 where q is the correlation matrix; E is the ...
1
vote
0answers
27 views

How to find covariance of sample mean and sample standard deviation

I have a question to find the covariance of sample mean and sample standard deviation based on the following: I have tried something on my scratch paper, but for some reason, I cannot upload on ...
1
vote
0answers
65 views

Covariance matrix using squared exponential function

I'm writing down the covariance matrix $K$ of a vector X using squared exponential covariance function, and then evaluating the determinant of the matrix $K$. Let's say i add a new point to $X$ , and ...
1
vote
0answers
13 views

Augmenting a matrix with a highly-incorrelated column

Consider a binary matrix: $$\begin{pmatrix} 1 & -1 & 1 \\ -1 & 1 &1 \\ \vdots & \vdots &\vdots \\ 1 & 1 & -1\end{pmatrix}$$ with a random distribution of 1 and -1 ...
1
vote
0answers
10 views

Convergence under rank correlation

I have a following setup: Let $c\in{\Bbb R}$, $R^2\in [0,1]$ and $\Psi,\varepsilon_1,\varepsilon_2,\ldots$ independent random variables on a probability space $(\Omega,{\cal A},{\Bbb P})$. Define the ...
1
vote
0answers
36 views

Two forms of cross-correlation

Wikipedia and MATLAB defines cross-correlation in this way. In time series analysis (P21), it defines cross-correlation upon cross-covariance: Let $\{X_t\}$ and $\{Y_t\}$ be two time series, ...
1
vote
0answers
33 views

How can I get a Covariance Matrix from Mean and Variance?

this may be a very basic question. I have the mean and variance for 12 lognormal distributions: ...
1
vote
0answers
30 views

centering two variables X and Z makes cov (X,XZ) = 0

I've read that centering two normal (or symmetrical) variables $X$ and $Z$ affects correlation of centered $X$ with interaction term $X\cdot Z$ in such way, that this correlation $cor(X-EX, X\cdot Z)$ ...
1
vote
0answers
24 views

Multiple variables correlation

There are a number of entities. Each entity has three sets of parameters. Each set of parameters describes entity behaviour in a specific system. The problem is to find mathematical method that would ...
1
vote
0answers
59 views

Partial Correlation Coefficient

I have the following questions on computing the correlation coefficient. Let us say we have two discrete random variables $X_1$ and $X_2$, where $X_1$ has $n_1$ outcomes and $X_2$ has $n_2$ ...
1
vote
0answers
23 views

I'm confused on how to use chi squared for the correlation between age and reaction time

I am doing my IB maths internal assessment and I am confused on how to specifically carry out chi squared with my given data. I will try to explain this quite plainly so the image is clear. I am ...
1
vote
0answers
20 views

Weighted Average of Correlation Matrix

Let $R$ and $Q$ be two correlation matrices of the same size and let $p\in[0,1]$. I'm trying to show that $pR+(1-p)Q$ is still a correlation matrix. I claim that $\sqrt pX+\sqrt{1-p}Y$ is a vector ...
1
vote
0answers
69 views

Definition of Autocorrelation Function (ACF)

For a weakly stationary time series $\left\{r_{t}\right\}$, the definition of ACF is (from Ruey Tsay's "Analysis of Financial Time Series") $$ ...
1
vote
0answers
12 views

Proving $Corr(\hat{e}_{ij}, \hat{e}_{jk}) = \frac{-1}{n_i-1}$ for $ j \neq k$

For the model of a single factor experiment: $y_{ij}= \mu + \alpha_i + e_{ij}$, $(1 \leq i \leq a, 1 \leq j \leq n_i)$, where a = the number of treatments, $n_i$ = the number of experimental units ...
1
vote
0answers
37 views

OLS standard error that corrects for autocorrelation but not heteroskedasticity

Question: By mapping the OLS regression into the GMM framework, write the formula for the standard error of the OLS regression coefficients that corrects for autocorrelation but not ...
1
vote
0answers
27 views

Bounding the Correlation Coefficient

Let us assume we have two random variables $X$ and $Y$ where $X = f(A, B, C)$ and $Y = g(A, B, C)$. $A, B, C$ are 3 independent random variables and the functions $f, g$ are known but rather expensive ...
1
vote
0answers
44 views

Correlation Statistic with a neutral score

I'm trying to develop a correlation statistic to compare lines/random variables (represented as a series of points). I want the correlation value to convey little information if one the lines is a ...
1
vote
0answers
127 views

Autocorrelation Function and Power spectrum from ACF

In my assignment I am required to write or use a C code to find the autocorrelation function of a given function and then find the power spectrum from it. The function is as follows: $$f(t) = \cos(10 ...
1
vote
0answers
20 views

Maximum correlation of n variables

For $n>2$ variables, one cannot arbitrarily choose the correlations $\rho_{ij}$ because the resultant correlations must obey the law of cosines. Equivalently, the covariance matrix between them ...
1
vote
0answers
187 views

Generate correlated random numbers precisely

Let's assume I want to generate k samples of n random numbers, that are correlated according to a given correlation matrix C (e.g. $n = 3$): ...
1
vote
0answers
88 views

Spatio-temporal triple correlation

I would like to simplify if possible the spatio-temporal triple correlation of the following function: $$f(\vec{x},t)=\delta(\vec{x}-\vec{x}_0(t)) \otimes f_p(\vec{x})$$ where $\delta$ is the Dirac ...