For questions about correlation of two random variables. Use it with [tag: random-variables] and [tag: probability].

learn more… | top users | synonyms

0
votes
0answers
91 views

Correlated variables from Latin Hypercube

Say I have a vector $\mathbf{Y}$ of $n$ normally distributed random variables. I have its mean vector $\mu$ and covariance matrix $\Sigma$. Normally if I were to generate a sample, I would decompose ...
0
votes
0answers
44 views

Generate two sets of (nonlinearly) dependent random numbers

I would like to find a method to generate two sets of (nonlinearly) dependent random numbers. Solution for linear dependence (that is, correlation). Generate two sets of uncorrelated random numbers ...
-2
votes
1answer
61 views

Combination problem: random selection in a group

A scientific committee of 4 persons is to be randomly selected from a group consisting of 3 biologists, 3 physicists and 4 mathematicians. Let X denote the number of biologists, Y the number of ...
2
votes
0answers
35 views

Best line fit for correlated points

Given in $\mathbb{R}^3$ are $n$ points $\mathbf{y}_i\sim N(\mathbf{y}_i-\mathbf{\hat{y}}_i, \mathbf{C}_i)$, which are normally distributed. I want to determine a best fit line $\mathbf{u}(\lambda) = ...
0
votes
0answers
15 views

Is auto-correlation a particular and simple form of pattern in time series?

In a time serie context and considering the sign of the variation of the variable auto-correlation means that for couple of measures at (time t, time t+1) the ...
1
vote
0answers
37 views

OLS standard error that corrects for autocorrelation but not heteroskedasticity

Question: By mapping the OLS regression into the GMM framework, write the formula for the standard error of the OLS regression coefficients that corrects for autocorrelation but not ...
2
votes
1answer
30 views

Is $d(i,j) = 1-\textrm{corr}(i,j)$ a metric?

I need to make sure that this function is a metric: $d(i,j) = 1-\textrm{corr}(i,j)$ where $\textrm{corr}(x,y)$ is the Pearson correlation coefficient which ranges from $[-1,1]$. With this scaling I ...
1
vote
0answers
27 views

Bounding the Correlation Coefficient

Let us assume we have two random variables $X$ and $Y$ where $X = f(A, B, C)$ and $Y = g(A, B, C)$. $A, B, C$ are 3 independent random variables and the functions $f, g$ are known but rather expensive ...
0
votes
0answers
76 views

Difference between identity and diagonal covariance matrices

thanks in advance for the help. Suppose I am training a linear model. What are the conceptual differences between using a diagonal covariance matrix and the identity? It is clear to me that the ...
0
votes
1answer
21 views

Covariance matrix computed based on a covariance function

I am reading Chapter 4 of Gaussian Processes for Machine Learning. It says that a matrix $K$ whose entries are computed as $k_{ij} = k(x_i, x_j)$ where $k$ is a covariance function is a positive ...
1
vote
1answer
84 views

Constraints on correlation coefficients of multiple random variables

I am looking for a generalization of Correlation between three variables question for more than three variables. It is stated in one of the answers there that, for three variables with pairwise ...
0
votes
0answers
25 views

Test indipendence and stationarity

I have to apply a model on a dataset of $I$ variables, each one with $n$ observations, but I need that every variable is stationary and indipendent from the other ones for the model to work. My ...
0
votes
2answers
76 views

How to find relation between 2 numbers

I have been practicing programming for many months now and what I found difficult is not about solving problem. But it is how to find the "how to solve problem" to make computer solves that for me! ...
0
votes
0answers
52 views

Error propagation in pearson correlation

I have two data-sets $X$ and $Y$ with errors $\Delta X$ and $\Delta Y$. I calculated the Pearson Sample Correlation $r$. Is it possible to calculate the error of $r$ using propagation of uncertainty: ...
0
votes
0answers
14 views

Methods for Uncorrelating data - Comparison

I see that both PCA and Cholesky Decomposition could be used for uncorrelating correlated data. When should one be used? What are the assumptions made by each model. When do the methods fail? Are ...
1
vote
2answers
46 views

Correlation of random variables with joint PDF proportional to $x^{a-1}y^{b-1}(1-x-y)^{c-1} $

The random variables $X$ and $Y$ have joint PDF $$f(x,y)= \frac{\Gamma(a+b+c)}{\Gamma(a)\Gamma(b)\Gamma(c)}x^{a-1}y^{b-1}(1-x-y)^{c-1} $$ where $0 \leq x \leq 1 , 0 \leq y \leq 1, x+y < 1 $ where ...
0
votes
0answers
59 views

Checking hand manipulations of matrices

Beginning with a 4*3 matrix: 5 4 -1 2 3 -3 3 4 -4 1 3 -2 I have to perform four manipulations on it, which I did by hand. I wanted to ask if my thinking and/or ...
1
vote
2answers
74 views

What is the intuitive meaning of uncorrelated?

I was going through the derivation of the Kalman filter and it mentions that since noise (v) is uncorrelated to the state (x) and the state estimate (xbar), the following quantity is zero: E((x - ...
0
votes
0answers
27 views

Exponentially weighted rank ordered correlation matrix

Is there any well-known method to apply exponential weighting (similar to EWMA) to rank ordered correlation matrices such as Kendall tau or Spearman?
0
votes
0answers
68 views

Generate Correlated Normal and Log-Normal Random Variable

The standard approach for generating two normally distributed random variables some with correlation $\rho$ is explained here: Generate Correlated Normal Random Variables. Now let $X,Y$ be normally ...
1
vote
2answers
49 views

Probability of observing a false correlation and confidence limits

In oil and gas exploration/development it is common to use acustic impedance derived from reflection seismic surveys to predict the porosity measured in wells drilled in the reservoir. I often use ...
1
vote
1answer
20 views

Re-calculating Value of $100 in Each State by Specific State

I'm using this Tax Foundations graphic for data. How would I re-calculate each state based on a specific state? For example, what if I wanted to base the control state on Missouri, which is $113.51. ...
0
votes
0answers
126 views

Can Pearson's correlation coefficient be computed for 3d surfaces

I have two functions $f(x,y)=z$ and $g(x,y)=z$ given on discrete intervals $x_1,\ldots,x_n$ and $y_1,\ldots,y_n$... In other words, I have 2 matrices of dimension $3\times n$ representing discrete ...
0
votes
1answer
57 views

Determine Patterns

I have some weather data that I would like to analyze. I have about a millions rows of data, and each row has about 100 attribute values. Each attribute value represents some measurement (i.e., ...
-1
votes
2answers
176 views

Autocorrelation function and power spectral density

I want to get the autocorrelation function of the power spectral density of the wind. This function is defined by: $$s(\omega)=\frac{c_1}{(1+1.5 \times c_2\omega)^{5/3}}$$ $c_1$ and $c_2$ are ...
0
votes
1answer
81 views

Regression with Mean, Standard Deviation, Range and Correlation

A research team collected data on students in a statistics course. Their dependent variable was the student’s score on the final examination, which ranged from 200 to 800 points. The observed average ...
6
votes
1answer
166 views

Weighing correlation by sample size

I'm a scholar in the humanities trying to not be a complete idiot about statistics. I have a problem relevant to some philological articles I'm writing. To avoid introducing the obscure technicalities ...
1
vote
1answer
57 views

Sample Size for Correlation Testing

A research team wishes to test the null hypothesis: $H_0, r=0$ at $\alpha = 0.025$ against the alternative: $H_1, r>0$ using Fisher’s transformation of the Pearson product moment correlation ...
0
votes
1answer
29 views

Work out if the relationship between 2 datasets is constant

I have 2 one-dimensional datasets, let's call them a and b. I want to know the correlation between ...
0
votes
1answer
136 views

Correlated Rayleigh random variable generation

How to generate 4 correlated random variables Rayleigh distributed with parameter "a" and the co-variance matrix is toeplitz (1 rho rho^2 rho^3) where rho is the correlation coefficient
1
vote
1answer
137 views

What test should I use to statistically compare two intraclass correlation coefficients (ICC)?

I need to compare two generalizability (G) coefficients for data that are from two separate populations. G coefficients are a type of intraclass correlation coefficient (ICC). The literature on ...
1
vote
0answers
47 views

Correlation Statistic with a neutral score

I'm trying to develop a correlation statistic to compare lines/random variables (represented as a series of points). I want the correlation value to convey little information if one the lines is a ...
0
votes
1answer
106 views

Summing dependent random variables with unknown joint cdf

Suppose that X_1, X_2,... X_5000 are discrete and dependent non-identically distributed random variables, whose marginal distributions are known, but whose joint distribution is not known. Is there ...
0
votes
1answer
38 views

correlation estimator variance

Consider I have realisations of two random variables $X$ and $Y$ and I estimate their correlation thanks to the classic formula : ...
-1
votes
1answer
57 views

correlation matching audio files peak position

if i cross correlate an audio file with itself (which means there is no delay or difference), the peak position should be a zero or at the center of the cross correlation? that is really confusing ...
0
votes
1answer
47 views

Convolution module

I am trying to apply GCC-PHAT algorithm here to process audio files and find delay between them. Im coding using Android and Java with the help of this library, and comparing the results with Matlab. ...
2
votes
0answers
149 views

Expectation and convolution question.

I am learning in an image processing course, and the professor did the following: As part of a derivation, has this: What I do not understand, is how he was able to remove $r(i,j)$ to the ...
0
votes
1answer
146 views

Correlation coefficient of i.i.d variables

Let $X_1, X_2, X_3, ...$ be i.i.d variables, and for every $i$ $X_i$ has variance. Define $S_k=\sum_{i=1}^{k}X_i$. Calculate $\rho(S_m,S_n)$ for $m\leq n$. Well, I know it should be $\sqrt{ m/n }$, ...
1
vote
2answers
60 views

Finding the correlation coefficient of ordered statistics

I am working on the following problem. Let $$X_{(1)}, \ldots ,X_{(n)}$$ be the order statistics from the uniform distribution of $[0,1]$. Find the coefficient correlation of $X_{(1)}$ and ...
1
vote
1answer
65 views

How do you prove that if $ X_t \sim^{iid} (0,1) $, then $ E(X_t^{2}X_{t-j}^{2}) = E(X_t^{2})E(X_{t-j}^{2})$?

Suppose we have a time series $X_t$ s.t. $X_t \sim^{iid} (0,1)$. How do you prove that if $ X_t \sim^{iid} (0,1) $, then $ E(X_t^{2}X_{t-j}^{2}) = E(X_t^{2})E(X_{t-j}^{2})$? Or, I guess, if ...
0
votes
2answers
98 views

Correlation coefficient calculation

Why do we remove of the mean of the data while calculating the correlation coefficient value of bivariate data in statistics? DotProduct/ProductOfLengthOfVectors should always give anyway a ...
0
votes
0answers
35 views

Multiple correlation

My question is very elementary. I need to implement a software that computes the multiple correlation of a set of datas that I have. In order to do that, I need would like to find the generic formula ...
1
vote
2answers
41 views

What is this idea of “Minimum Correlation”?

So I was having a read of this paper here: Minimum correlation for any bivariate Geometric distribution. On the first page of he paper we encounter the following definition of "minimum correlation": ...
0
votes
1answer
35 views

Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$. Is it true that: If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...
1
vote
2answers
51 views

Autocorrelation and var-cov matrix

$$Y_t=\beta_1+\beta_2 X_{t2}+\dots +\beta_k X_{tk}+\epsilon_t \qquad (t=1,\dots,T)$$ $$\epsilon_t=\rho \epsilon_{t-1}+v_t, \qquad v_t \sim \mathrm{i.i.d.}(0,\sigma^2_v)$$ GLS estimation under AR(1) ...
1
vote
2answers
46 views

Determine range of $\rho$ in correlation matrix

I was asked a question and I was wondering if you can help solve it. Given are $3$ random variables $A$, $B$and $C$ all having the same correlation. So the correlation matrix looks like: ...
0
votes
1answer
27 views

Does correlation have to be in the context of (Gaussian) normal distribution?

I am not quite familiar with the concept of correlation. The Pearson's correlation coefficient is defined as: $\rho_{X,Y}=\mathrm{corr}(X,Y)={\mathrm{cov}(X,Y) \over \sigma_X \sigma_Y} ...
0
votes
1answer
87 views

How to calculate the HHG (Heller Heller Gorfine) correlation

HHG (A consistent multivariate test of association based on ranks of distances) is introduced in: Heller, R., Heller, Y., & Gorfine, M. (2012b). A consistent multivariate test of association ...
0
votes
1answer
155 views

Correlation with many zero values

I have data for selling books from 2 bookstores for 100 days. For the first 90 days, no book was sold. Then the following books were sold Day# - BookStore1 - BookStore2 Day1 - 0 - 0 ...
0
votes
2answers
128 views

Strong vs weak relationship in this correlation

I produced this plot and regression line in R and I thought my results were quite odd. Is the relationship of the correlation determined by how steep the regression line is? So in this case it isn't ...