For questions about correlation of two random variables. Use it with [tag: random-variables] and [tag: probability].

learn more… | top users | synonyms

3
votes
0answers
144 views

How to perform nonlinear regression with correlated errors?

I have a nonlinear least squares problem, but the errors are correlated. I could use R's nls function to do the regression if the errors were independent, but I don't know the right way to handle ...
3
votes
0answers
868 views

Correlation and Regression Question

Two separate tests are designed to measure a students ability to solve problems. Several students are randomly selected to take both tests and the results are: $$ \begin{matrix} \text{Test A}(x) ...
2
votes
0answers
33 views

Best line fit for correlated points

Given in $\mathbb{R}^3$ are $n$ points $\mathbf{y}_i\sim N(\mathbf{y}_i-\mathbf{\hat{y}}_i, \mathbf{C}_i)$, which are normally distributed. I want to determine a best fit line $\mathbf{u}(\lambda) = ...
2
votes
0answers
69 views

Expectation and convolution question.

I am learning in an image processing course, and the professor did the following: As part of a derivation, has this: What I do not understand, is how he was able to remove $r(i,j)$ to the ...
2
votes
0answers
24 views

correlation estimator

Suppose I have independent variables $X$ and $Y$ which follows exponential distribution with parameter $\lambda$. I want to find the variance of correlation estimator $\hat{\rho}$ which is defined as: ...
2
votes
0answers
18 views

Detecting camera shake

I have a bunch of data captured from a worm tracker that consists of a B&W camera that stares down at a few dozen worms for an hour at a time. The tracker captures the outline of each worm ...
2
votes
0answers
67 views

Show that a function is log supermodular

I have been struggling with the following Let $X$ be finite and a poset $P = (X, \leq)$, and for any $A \subseteq X$ we can define the function $f_A$ on $\mathcal{P}(A)$ as follows $$ f_A(Y) = \#\{ ...
2
votes
0answers
27 views

Autocorrelation Clarification

Could anyone help clarify a high level explanation of autocorrelation? I understand that it is a measure of correlation between a timeseries and a lagged version of the same series. If we have take ...
2
votes
0answers
74 views

Expectation of random variables

a) Show that $E\{X-E(X)\} = 0$ for any random variable $X$. b) Use the result in part (a) and the following equation to show that if two random variables are independent then they are uncorrelated, If ...
2
votes
0answers
71 views

When does convergence in distributions inply convergence in covariance?

Good Morning. Let $(X_n)_n$ and $(Y_n)_n$ be sequences of random variables converging in distribution respectively to $X$ e $Y$. Suppose $X_n,Y_n$ are equally distributed but dependent for all $n$, ...
2
votes
0answers
44 views

A vector with fixed correlation with existing vector, is it always possible?

Suppose we have a known vector $X$ in $R^n$, and for any vector $Y$ in $R^n$, we impose on it the restriction that it must have a fixed correlation coefficient $r$ with $X$: \begin{align*} ...
2
votes
0answers
35 views

Finding correlations between many unknown functions.

Given an arbitrarily large number of black-box functions of one variable, is it possible to produce expressions that approximate their relationships to each other over their shared domain? Is it ...
2
votes
0answers
59 views

Dimension free Concentration bounds for Martingales

Consider the following random process which is defined on $n$ numbers $0\leq x_1,\ldots,x_n\leq 1$: At each step, pick an arbitrary number, say $x_i$. Then randomly (and independently) change its ...
2
votes
0answers
70 views

Finding the empirical correlation from a covariance matrix

I have this covariance matrix with five variables $X_1$ through $X_5$ in that order. ...
2
votes
0answers
882 views

What do angle brackets ($\langle\rangle$ ) mean in mathematics/statistics (autocorrelations)?

Okay, so the logarithmic return on a stock is given by: $$r_τ (t) = \ln P(t+τ) - \ln P(t),$$ where τ is the interval of time. I have no problem calculating that. My question comes to the following ...
2
votes
0answers
393 views

Pearson correlation and metric properties

Assuming that the data set was $z$-standardized to zero mean and unit variance (also assuming that it does not contain constant vectors). Then Pearson's r reduces to Covariance: $$\rho(X,Y) := ...
2
votes
0answers
114 views

Correlation between an event and a time series

I have a time series, e.g. the daily number of visitors on my blog. I have a set of events of some class, like the days when I made a new posting. I want to measure the effect of a new posting on the ...
2
votes
0answers
178 views

Correlated diffusion processes and covariance matrix

I'm really noob in maths topics so I hope you will excuse me if I use terms which aren't correct. I would like to simulate $n$ dimensional diffusion processes with $n$ noises. Each process has its ...
2
votes
0answers
231 views

Geometric interpretation of element by element division of one vector by another

This is my first post here, and I'm not a mathematician, so please go easy on me :) In statistics there is a geometric interpretation of correlation that uses basic vector geometry. This is fairly ...
1
vote
0answers
32 views

Partial Correlation Coefficient

I have the following questions on computing the correlation coefficient. Let us say we have two discrete random variables $X_1$ and $X_2$, where $X_1$ has $n_1$ outcomes and $X_2$ has $n_2$ ...
1
vote
0answers
13 views

I'm confused on how to use chi squared for the correlation between age and reaction time

I am doing my IB maths internal assessment and I am confused on how to specifically carry out chi squared with my given data. I will try to explain this quite plainly so the image is clear. I am ...
1
vote
0answers
10 views

Weighted Average of Correlation Matrix

Let $R$ and $Q$ be two correlation matrices of the same size and let $p\in[0,1]$. I'm trying to show that $pR+(1-p)Q$ is still a correlation matrix. I claim that $\sqrt pX+\sqrt{1-p}Y$ is a vector ...
1
vote
0answers
17 views

Definition of Autocorrelation Function (ACF)

For a weakly stationary time series $\left\{r_{t}\right\}$, the definition of ACF is (from Ruey Tsay's "Analysis of Financial Time Series") $$ ...
1
vote
0answers
9 views

Proving $Corr(\hat{e}_{ij}, \hat{e}_{jk}) = \frac{-1}{n_i-1}$ for $ j \neq k$

For the model of a single factor experiment: $y_{ij}= \mu + \alpha_i + e_{ij}$, $(1 \leq i \leq a, 1 \leq j \leq n_i)$, where a = the number of treatments, $n_i$ = the number of experimental units ...
1
vote
0answers
21 views

Bounding the Correlation Coefficient

Let us assume we have two random variables $X$ and $Y$ where $X = f(A, B, C)$ and $Y = g(A, B, C)$. $A, B, C$ are 3 independent random variables and the functions $f, g$ are known but rather expensive ...
1
vote
0answers
15 views

Maximum correlation of n variables

For $n>2$ variables, one cannot arbitrarily choose the correlations $\rho_{ij}$ because the resultant correlations must obey the law of cosines. Equivalently, the covariance matrix between them ...
1
vote
0answers
119 views

Generate correlated random numbers precisely

Let's assume I want to generate k samples of n random numbers, that are correlated according to a given correlation matrix C (e.g. $n = 3$): ...
1
vote
0answers
81 views

Spatio-temporal triple correlation

I would like to simplify if possible the spatio-temporal triple correlation of the following function: $$f(\vec{x},t)=\delta(\vec{x}-\vec{x}_0(t)) \otimes f_p(\vec{x})$$ where $\delta$ is the Dirac ...
1
vote
0answers
27 views

What is correlated with what in a linear regression?

I'm trying to make sure I understand the ins and outs of a linear regression and am making a table for what is correlated with what, so just want to see if I have everything included. I'm looking at ...
1
vote
0answers
79 views

Using mutual information to estimate correlation between a continuous variable and a categorical variable

As for the title, the idea is to use mutual information, here and after MI, to estimate "correlation" (defined as "how much I know about A when I know B") between a continuous variable and a ...
1
vote
0answers
15 views

Can correlation dimension of an attractor exceed the dimension of the space?

Here is the definition of the correlation dimension: http://en.wikipedia.org/wiki/Correlation_dimension Is there a proof that the correlation dimension cannon exceed the dimension of the space?
1
vote
0answers
72 views

Interval of non-uniformly distributed set of numbers adjusted that it properly excludes extremes

Let's say I have an interval of numbers from 1 to 9 with the following frequency of distribution: numbers 1, 2 and 3 about 20 occurrences number 6 has 2 occurrences and number 9 has only ...
1
vote
0answers
51 views

Multiple regression and hypothesis test $H_0$:$\beta_2=0$

Multiple regression model $H_0$:$\beta_2=0$, $H_1$:$\beta_2 \neq 0$ where $\beta_2$ is the vector of elements ($\beta_2, \beta_3, \dots, \beta_k$) and $\beta$ is slope of regression line. Why it is ...
1
vote
0answers
50 views

Redundancies in covariance matrix

We know that covariance matrix is symmetrical. I have a vague intuition that there may be some other redundancies beyond that. For example, if A is correlated to B and B is correlated to C then A and ...
1
vote
0answers
31 views

Finding correlation of data with potentially hidden time lags

Let's say I have few independent variables plus multiple observables that I monitor over time for a system. I'd like to find out if there is any correlation between the observables and any of the ...
1
vote
0answers
117 views

Probability and correlation function, interpretation of a result

My question is originated from the paper ...
1
vote
0answers
73 views

Calculation of conditional joint probability given certain conditionals for data which aren't independent

The context of this problem is the estimation of the distribution of a parameter $v$ given sets of data $A$ and $B$, where $A$ and $B$ are not independent. Suppose I know $P(v | A)$ and $P(v | B)$. ...
1
vote
0answers
45 views

Sorting Vectors based on their correlation

This problem [question]: Sort vectors according to their distance between them is about sorting vectors based on the distance between them. What about sorting vectors based on the correlation ...
1
vote
0answers
22 views

Estimating the likelihood of independence of two discrete variables using the co-occurrence count matrix.

I have some data about users from different regions visiting different directories of some website. Aggregating that data I get the co-occurrence frequency matrix (for regions and directories). Now I ...
1
vote
0answers
191 views

Cross-Correlation (and finding Correlation error ) of two digital sequences.

In a IEEE paper, I saw a formula for WUInt(ti+1) as , Reference : ...
1
vote
0answers
88 views

Compute significance of Kendall tau-b?

I have so-far tried all ways of computing kendall tau significance (where there are ties) described here. However, none of them works good, even for relatively large vectors. I think the problem is ...
1
vote
0answers
116 views

Windowed Linear Correlation

$\DeclareMathOperator \Cov {Cov}$ $\DeclareMathOperator \Var {Var}$ $\DeclareMathOperator \E {E}$ Consider the following experiment: For $N\geq1$, consider $N$ black balls. Let us paint each black ...
1
vote
0answers
29 views

Dynamic Light Scattering

In DLS does the combination of the Time Average and Ensemble Average give a better statistical average than the results shown by each case considered separately ?
1
vote
0answers
198 views

Cross Correlation

The cross-correlation function is defined as follows if $\bar{f}$ is the complex conjugate of $f$ and we assume that $f$ is real, such that $\bar{f} = f$. $$ \begin{align} f \star g &= ...
1
vote
0answers
49 views

Sampling a distribution with restrictions: eliminating the correlation between two variables

I have a collection of 400.000+ word-pairs. Each word-pair has an association strength, which is a measure of how related the two words are to each other (as in cow-milk). Each word-pair also has a ...
1
vote
0answers
127 views

Correlated Random Numbers Between A Range

I am trying to generate random numbers within a range say 57 to 107 which are correlated by a factor of 0.8. The numbers are for illustration simplicity only.
0
votes
0answers
11 views

different way to compute power spectral density

I am writting a piece of code to compute power spectral density (psd) of a signal and wanted to compare two approaches : compute the FFT of the signal and square its amplitude compute the biased ...
0
votes
0answers
17 views

Product of two random variables - Resulting Distribution and Correlation?

Let $X \sim \mathcal{N}(0,1)$ and let $Z$ be a random variable independent of $X$ such that \begin{align*} P(Z=z) = \begin{cases}\frac{1}{2} & z=-1\\ \frac{1}{2} & z = 1\\ 0 & ...
0
votes
0answers
15 views

correlation coefficient is over 0.7

"correlation coefficient can be over 0.7 then we can say Two factors have some strong relation. Then What is the 'reason' that we can say like that? Explain it." I got that problem and I really dont ...
0
votes
0answers
13 views

Relationships between numbers

So I'm working on this idea that I had, Example: There are 3 people in a room how many hand shakes would it take for all of them to hand shake. The answer is 3. I've done the work up to 8 ...