0
votes
1answer
45 views

Summing dependent random variables with unknown joint cdf

Suppose that X_1, X_2,... X_5000 are discrete and dependent non-identically distributed random variables, whose marginal distributions are known, but whose joint distribution is not known. Is there ...
1
vote
1answer
31 views

How do you prove that if $ X_t \sim^{iid} (0,1) $, then $ E(X_t^{2}X_{t-j}^{2}) = E(X_t^{2})E(X_{t-j}^{2})$?

Suppose we have a time series $X_t$ s.t. $X_t \sim^{iid} (0,1)$. How do you prove that if $ X_t \sim^{iid} (0,1) $, then $ E(X_t^{2}X_{t-j}^{2}) = E(X_t^{2})E(X_{t-j}^{2})$? Or, I guess, if ...
1
vote
2answers
31 views

What is this idea of “Minimum Correlation”?

So I was having a read of this paper here: Minimum correlation for any bivariate Geometric distribution. On the first page of he paper we encounter the following definition of "minimum correlation": ...
0
votes
1answer
22 views

Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$. Is it true that: If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...
2
votes
0answers
22 views

correlation estimator

Suppose I have independent variables $X$ and $Y$ which follows exponential distribution with parameter $\lambda$. I want to find the variance of correlation estimator $\hat{\rho}$ which is defined as: ...
2
votes
1answer
39 views

$\rho_\gamma(X)=\frac{1}{\gamma} \log \mathbb{E}[e^{-\gamma X}]$

$\rho_\gamma(X)=\frac{1}{\gamma} \log \mathbb{E}[e^{-\gamma X}]$ is a convex risk measure, but it fails the subadditivity property in order to be called coherent. A mapping ...
2
votes
1answer
51 views

probability need help on correlation problem [duplicate]

A deck of 52 cards is shuffled you are dealt 13 cards. Let $X$ and $Y$ denote, respectively, the number of aces and the number of spades in your hand. Show that $X$ and $Y$ are uncorrelated. I try to ...
3
votes
1answer
46 views

finding the unspecified ${\bf E}[X]$ and $\rm var(X)$ given the expectation of higher powers of $X$

Homework Problem: It is known that a for a standard normal random variable $X$, we have ${\bf E}[X^3]=0$, ${\bf E}[X^4]=3$, ${\bf E}[X^5]=0$, ${\bf E}[X^6]=15$. Find the correlation coefficient ...
1
vote
4answers
370 views

Inferring covariance cov[X,Z] from cov[X,Y] and cov[Y,Z] of known distributions

Suppose X, Y and Z are real random variables of known distributions. If one knows the covariance $COV(X,Y)$ and $COV(Y,Z)$, is it possible to infer $COV(X,Z)$?
0
votes
1answer
114 views

Correlation between complex random variables

I am struggling to find the correlation between two complex r.vs; X and 1/Y i.e. E{X*/Y}, where '*' denotes the conjugation operator. The complex r.s X and Y are correlated with each other with known ...
1
vote
2answers
66 views

Correlation coefficient

I'm a little puzzled by the whole random variable thing. I've got two random variables, $\mathcal{X}$ and $\mathcal{N}$, both with gaussian distribution with mean = 0 and $\sigma_{\mathcal{X}}^2$ and ...
0
votes
1answer
61 views

How can we derive expectation of two dependent normal distribution?

$\mathbf{X}$ and $\mathbf{Y}$ are each dependent normal random variable, then how can we derive like this one? $$\mathbf{E}\{e^{\mathbf{X}}e^{\mathbf{Y}}\}$$ I know the each first moment is ...
0
votes
0answers
13 views

Indepedence of sample means of two orthogonal Gaussian vectors?

Suppose $\boldsymbol{x}_{1}$ and $\boldsymbol{x}_{2}$ are Gaussian vectors with each distinct but arbitrary means and covariances, i.e., the elements of each vector are generally intra-correlated. ...
1
vote
0answers
63 views

Using mutual information to estimate correlation between a continuous variable and a categorical variable

As for the title, the idea is to use mutual information, here and after MI, to estimate "correlation" (defined as "how much I know about A when I know B") between a continuous variable and a ...
0
votes
2answers
980 views

Expected value of two dependent variables is still a product of expectations

For independent variables we have $E[XY]=E[X]E[Y]$. Now, since I could not find a statement that the converse is also true, I suspect that there are examples of dependent variables where this relation ...
0
votes
2answers
118 views

If $E(Y\mid X)$ is constant then $X, Y$ are uncorrelated.

Last minute studying please tell me how to: Prove that if the expected conditional expected value of the random variable $X$ given the random variable $Y$ - denoted by $E(X\mid Y)$ - is constant ...
0
votes
2answers
39 views

Finding a Correlation between Bernoulli Variables?

Let X and Y be Bernoulli random variables. We don't assume independence or identical distribution, but we do assume that all 4 of the following probabilities are nonzero. Let a := P[X = 1, Y = 1], b ...
3
votes
3answers
275 views

Is correlation (in some sense) transitive?

If we know that A has some correlation with B ($\rho_{AB}$), and that B has some with C ($\rho_{BC}$), is there something we know to say about the correlation between A and C ($\rho_{AC}$)? Thanks.
0
votes
1answer
28 views

Correlation of two Binomial RVs

Suppose a coin is flipped 30 times. Let X = #heads in first 20 flips, Y = #heads in second 20 flips. I want to find Corr(X, Y). I am only confused on how to find Cov( X, Y) = E[ XY] - E[ X]E[ Y], ...
0
votes
1answer
23 views

Correlation formula for discrete phenomena in time

I need a statistical formula to capture a particular phenomena that I need to model in software. I have a light that can be on or off. When turned on, it can be one of many colors (for example, ...
0
votes
1answer
50 views

Compute for Cov(X,Y) and Correlation(X,Y)

Let $(X, Y)$ be uniform on the half disc $D = \{(x, y) : 0 < y, x2 + y2 < 1\}$. How should I approach this problem. Should I solve double integral with inside goes from $-\sqrt1-x^2$ to ...
1
vote
1answer
27 views

Compute correlation between two random variables

A coin is flipped 100 times. Let $X$ be the number of heads in the first 70 flips and $Y$ the number of heads in the last 50. Compute the correlation of $X$ and $Y$. Here's my attempt: ...
1
vote
2answers
682 views

Solving for the covariance of a joint pdf

Let X and Y have a joint pdf given by $f_{x,y}(x,y) = \begin{cases} 1 & \text{if } 0<y<1,\text{ } y-1<x<1-y \\ 0 & \text{otherwise} \end{cases}$. (a) Find Cov(X,Y) and ...
2
votes
0answers
64 views

Expectation of random variables

a) Show that $E\{X-E(X)\} = 0$ for any random variable $X$. b) Use the result in part (a) and the following equation to show that if two random variables are independent then they are uncorrelated, If ...
1
vote
1answer
60 views

A question about Pearson correlation coefficient

Suppose that we have two vectors $x=(x_1,\ldots,x_n),y=(y_1,\ldots,y_n)$ is the following correct about their Pearson correlation coefficient? $\operatorname{corr}(x,y)=\operatorname{corr}(x+a,y+b)$ ...
0
votes
1answer
39 views

Multivariate Gaussian density from singular covariance

I have a multi-dimensional (~600dim) sample from which I determine its covariance matrix. The determinate of the covariance is 0. The sample does not show strong correlations when plotting 2 ...
0
votes
0answers
58 views

Expected value, correlation, and indepence.

I need help with a problem. Supposed x, y, and z are events in F (algebra of sets) in a probability space (universal set, F (algebra of sets), P). Define two random variables: a(omega) = ...
1
vote
0answers
94 views

Probability and correlation function, interpretation of a result

My question is originated from the paper ...
1
vote
0answers
68 views

Calculation of conditional joint probability given certain conditionals for data which aren't independent

The context of this problem is the estimation of the distribution of a parameter $v$ given sets of data $A$ and $B$, where $A$ and $B$ are not independent. Suppose I know $P(v | A)$ and $P(v | B)$. ...
1
vote
1answer
91 views

correlation of product with its normally distributed factors

If x and y are normally dist. with standard deviation of 10%, and they are independent, then their product X.Y is 71% correlated with Y (or X). I can show this empirically, but how to I prove it in ...
2
votes
0answers
56 views

Dimension free Concentration bounds for Martingales

Consider the following random process which is defined on $n$ numbers $0\leq x_1,\ldots,x_n\leq 1$: At each step, pick an arbitrary number, say $x_i$. Then randomly (and independently) change its ...
1
vote
1answer
256 views

Inequality concerning the pairwise correlation coefficients of three random variables

I was asked to prove: The correlation coefficients, $\rho_{12}$, $\rho_{23}$, $\rho_{13}$ between three random variables $X_1$, $X_2$, $X_3$ obey ...
0
votes
1answer
137 views

Covariance and Correlation

Suppose there were m married couples, but d of these 2m people have died. Regard the d deaths as striking the 2m people at random. Let X be the number of surviving couples. Find: a) E(X) b) Var(X) ...
0
votes
1answer
193 views

Correlation of Indicator Variables

Show that for indicator random variables $I_A$ and $I_B$ of Events $A$ and $B$: $Corr(I_A, I_B) = Corr(I_A^c, I_B^c) = -Corr(I_A, I_B^c) = -Corr(I_A^c, I_B)$ Deduce that if $A$ and $B$ are ...
0
votes
1answer
420 views

Invariance of the correlation coefficient under linear transformations [on hold]

Show that for arbitrary random variables $X$ and $Y$, and constants $a,b,c,d$ with $a$ and $c$ nonzero, $$ \mathrm{Corr}(aX+b,cY+d) = \begin{cases} \mathrm{Corr}(X,Y)\quad&\text{if }a \text{ and ...
1
vote
1answer
121 views

Is the relation of having positive covariance well behaved with respect to taking the inverse?

Let $X$ and $Y$ be two random variables, $X$ strictly positive. Assume that Cov$(X,Y)>0$. Does this imply that Cov$(1/X, Y)<0$? I know that being positively correlated is not a transitive ...
3
votes
2answers
96 views

Covariance$(X,Y) \geq 0$ if $X,Y \geq 0$?

I was wondering if you can say something about the covariance of two positive variables $X$ and $Y$?
1
vote
1answer
95 views

Does $0$ correlation imply independence for marginally normal distributions?

Assume $X \sim \mathcal N(\mu_1, \sigma_1^2)$ and $Y \sim \mathcal N(\mu_2, \sigma_2^2)$. If $\rho_{X,Y} = 0$ then $X \bot Y$. Can someone give a hint why this is true ?
0
votes
1answer
104 views

correlation between two different variables

I am studying stochastic processes and found the next problem: Let $A$ and $\Phi $ be two independent random variables such that $E(A) = 0$, $E(A^2) < \infty$, and $\Phi$ is uniformly distributed ...
0
votes
2answers
49 views

Correlation bound

Let x and y be two random variables such that: Corr(x,y) = b, where Corr(x,y) represents correlation between x and y, b is a scalar number in range of [-1, 1]. Let y' be an estimation of y. An ...
1
vote
0answers
22 views

Estimating the likelihood of independence of two discrete variables using the co-occurrence count matrix.

I have some data about users from different regions visiting different directories of some website. Aggregating that data I get the co-occurrence frequency matrix (for regions and directories). Now I ...
3
votes
4answers
4k views

Correlation between three variables question

I was asked this question regarding correlation recently, and although it seems intuitive, I still haven't worked out the answer satisfactorily. I hope you can help me out with this seemingly simple ...
3
votes
1answer
130 views

Autocorrelation of wrapped Wiener process

Let $\phi(t)$ be a Brownian Walk (Wiener Process), where $\phi\in[0,2\pi)$. As such we work with the variable $z(t)=e^{i\phi(t)}$. I would like to calculate $$E(z(t)z(t+\tau)).$$ This is equal to ...
1
vote
1answer
175 views

Find correlation of x and y, given E(Y|X) and E(X|Y)

Suppose that X and Y are random variables such that E(Y | X) = 7 - (1/4)x and E(X | Y) = 10 - Y . Determine the correlation of X and Y . Edit: So far I've got E(x)=4 E(y)=6 Now I'm trying to ...
1
vote
1answer
52 views

How can I show that $z_i =\cos(iw)$ where $w$ is uniform on $[0,2\pi]$ is a white noise process?

How can I show that $z_i =\cos(iw)$, where $w$ is uniform on $[0,2\pi]$ is a white noise process? So far, I have shown $E(z_i)=0$ by integrating. However, I need to show ...
0
votes
2answers
308 views

Step by step correlation calculation

I must understand how I can calculate the correlation for the following probability variables. ...
1
vote
0answers
115 views

Windowed Linear Correlation

$\DeclareMathOperator \Cov {Cov}$ $\DeclareMathOperator \Var {Var}$ $\DeclareMathOperator \E {E}$ Consider the following experiment: For $N\geq1$, consider $N$ black balls. Let us paint each black ...
3
votes
1answer
383 views

Necessary and sufficient conditions for a matrix to be a valid correlation matrix.

It's not too hard to see that any correlation matrix must have certain properties, such as all entries in the range -1 to 1, symmetric, positive semi-definite (excluding pathological cases like ...
1
vote
1answer
659 views

Probability that one normal distribution is greater than the other when they are correlated i.e (Not Independent)

Would like to know how to approach this question: Probability that one normal distribution is greater than the other when they are correlated i.e (Not Independent). Seen the solution for the ...
3
votes
2answers
95 views

Independence of Random Variables (kernel ICA)

In the paper Bach, F. R., & Jordan, M. I. (2002). Kernel Independent Component Analysis. Journal of Machine Learning Research, 3(1), 1-48. doi:10.1162/153244303768966085 I stumpled upon ...