Questions on (linear or nonlinear) regression, the fitting of functions that best approximate empirical data.

learn more… | top users | synonyms

1
vote
0answers
22 views

Incorrect angle detected between two planes

I want to calculate the angle between 2 planes, Reference plane and Plane1. When I feed the X,Y,Z co-ordinates of pointCloud to the function plane_fit.m (by Kevin Mattheus Moerman), I get the output ...
0
votes
0answers
16 views

why are the residual sums of squares less than the true sums of squared errors? [on hold]

How would I go about showing this is true: $\sum \hat{e_i}^{2} \leq \sum e_i^{2}$ The LHS is SSE = Y(I-H)Y' and the RHS are the true squared errors.
0
votes
0answers
15 views

Algebraic expression of a regression matrix

Let's say I'm doing a multivariate regression between a set of input $n$-dimension vectors (noted by the matrix $X=\{X_1,X_2,...X_m\}$) and a transformed version (noted by the matrix ...
0
votes
0answers
29 views

Hypothesis testing - Beta coefficient

Apologies if this is trivial, just linke me somewhere. I'm currently taking statistics 101, I can't wrap my head around the hypothesis testing of coefficients. As follows, the t-test reads $$T=\frac ...
0
votes
0answers
24 views

Which model to be used for predictive analysis [on hold]

I have a problem where i have been given set of data against month example Month | Data1 | Data2 1---------5--------5 2---------6--------7 Consider the data 1 be the temperature and data 2 be the ...
0
votes
0answers
9 views

MSE in case of log-transformed dependent variable

Let's consider the following log-linear model: $log(Y_i) = \alpha + X_i\beta + \epsilon_i$ for i = 1, ..., N The fitted value is: $\widehat{log(Y)} = \hat{\alpha} + X\hat{\beta}$ Assuming ...
0
votes
0answers
13 views

Curve fitting using a graph extracted from an article, is it possible?

I want to curve fit a graph from an article which I can only extract from the pdf file as a screenshot. Therefore, I do not have the coordinates of the data points explicitly, yet I know that the ...
0
votes
0answers
15 views

How to compute confidence bound in linear regression

In a simple linear regression problem, let $A$ be an $m\times n$ matrix of samples, $A=[x^T_1; x^T_2; ...;x^T_m]$, $w$ is the $n\times 1$ parameter vector, and $b$ is $m\times 1$ response vector. The ...
0
votes
0answers
12 views

If someone can please explain to me how to determine the score for each variable in the data set and explain how to input into stat crunch? [on hold]

the question says, there are 3 types of tv programs with 9 commercials embedded in each show. group v is violence. s is sex content rating and n is neutral with neither a V or S rating. the dependent ...
1
vote
0answers
7 views

Regression question (details inside). Measuring the incremental impact on the dependent variable of one category over other categories

Formulate a regression equation you would use to test for the differences in ROE between firms that used tier 1 investment banks as their advisors and those that used tier 2 or tier 3 banks (note: ...
0
votes
1answer
41 views

Optimization Problem (Linear Algebra)

I am not trying to cheat or anything, so any reference to online literature or MOOCs, that teach this stuff, will be highly appreciated. The problem is to prove that the following optimization ...
1
vote
0answers
12 views

Statistics linear modelling in R

Suppose I have a date set of the form: Test Subject/Sex/No. of mistakes made in the morning/ No. of mistakes made in the afternoon A / M / 2 / 5 B / F / 1 / 4 C / M / 3 / 5 D / F / 1 / 5 Suppose ...
0
votes
0answers
33 views

$E(\bar{Y})=\bar{Y}$? [Linear Regression]

A book, I am reading, derives the covariance between $b_0$ and $b_1$ as follows: By definition, $$Cov(b_0,b_1)=E[(b_0-Eb_0)(b_1-Eb_1)]$$ $$=E[(b_0-\beta_0)(b_1-\beta_1)]$$ ...
1
vote
0answers
12 views

Cannot figure out autocavariance

The moving average model of order q has the form $$Y_t =β_0 +e_t +b_1e_{t−1} +b_2e_{t−2} +...+b_qe_{t−q}$$ where $e_t$ is a serially uncorrelated random variable with mean $0$ and variance $σ^2_e$. ...
1
vote
0answers
14 views

Time series regression

What if I have a stationary independent variable and 2 non-stationary dependent variables, and I want to run a regression on them, what model is the most appropriate?
-2
votes
2answers
28 views

Correlation coefficient from regression line [closed]

I encountered the below question in one of the interviews. Question : Suppose you have a random variable P and you define a new random variable $Q$ such that $Q = 2 - 3 P$. Calculate the value of ...
0
votes
0answers
22 views

Deriving single linear regression parameters in terms of multiple linear regression parameters

Suppose the true population model is ln(wage) = B0 + B1(education) + B2(experience) + v (v is error term) Suppose the model is estimated as ln(wage) = B3 + B4(education) + u How do I calculate ...
0
votes
1answer
31 views

Is there such a thing as a combination of linear and non-linear regression in one form?

Let's say I have a dataset D with many variables. I can get a multiple linear regression from that in the form ...
2
votes
1answer
32 views

How to take the derivative of Matrices

I was browsing the derivation of the Least Squares estimates and stumbled about this problem. It said that: $$E = (Y + XB)^2$$ $$\frac{dE}{dB} = -X^TY + X^TXB$$ It is to my understanding that the ...
1
vote
0answers
15 views

Derive the F-statistic for this model

Problem: Consider the model $y=\beta+\varepsilon$, where $\varepsilon\sim N_4(0,\sigma^2I)$, and $\sum_{i=1}^4\beta_i=0$. Derive the F-statistic for testing $H_0:\beta_1=\beta_2$. I tried to write the ...
1
vote
1answer
36 views

Size of sample and correlation coefficient

$X$ and $Y$'s correlation coefficient is $r=0.5$. What is the size of sample when the correlation is significant at $\alpha=0.05$ with two sided test? Is there a more "formal" way to solve this ...
0
votes
0answers
7 views

variance of regression coefficient of residual vector

y=ax+bz+u where x,y,and z are n*1 observation vector and u is an error vector.(x and z are independent.) Assume that x and z are non-random and that u has zero mean and covariance matrix σ^2In Let ...
1
vote
1answer
16 views

what is one basic/intermediate regression analysis standard textbook that is math intense

What is one basic/intermediate regression analysis standard textbook that is math intense with proofs/derivations? Also, i need that one to be comprehensive yet the diffculty is suitable for self ...
0
votes
1answer
25 views

Matrix form for Weighted Least Squares

If we have the following weighted least-squares regression, with $\hat{\beta} = (X'WX)^{-1}X'WY$ How can we express the squared errors, MSE and the fitted values in matrix form? These are the OLS ...
0
votes
1answer
32 views

How to find the deviated form of beta 1 in OLS

How to find the deviated form of beta 1 in OLS Y=β1+β2X+u estimated β1=(ΣX^2ΣY-ΣXΣXY)/(nΣX^2-(ΣX)^2) I do not know how to turn this part (ΣX^2ΣY-ΣXΣXY)into deviated form. I found that estimated ...
0
votes
0answers
10 views

If we make the lambda very small in ridge regression, why do the beta hats still decrease?

I understand that the betas estimated from minimizing the function (y hat - y)^2 + beta' beta decrease as lambda increase. However, looking at the picture below, why cannot we choose a lambda so ...
1
vote
1answer
19 views

Help Linear Regression

It would be really nice if someone could help me out and suggest me with his expert opinion. Going through the table and looking at Part (a) of this question. I believe I should use Scatter plot to ...
-1
votes
0answers
17 views

Understanding Linear Regression

Hello all. It's really good to be in here and I appreciate greatly to all the gurus who help people with their knowledge. It would be really nice if someone could help me out and suggest me with ...
2
votes
1answer
31 views

Standard Error in OLS Regression

Assuming I have the following linear regression set-up: $y_i = \alpha + x_i * \beta + \epsilon_i$ for $i = 1,2,..., n$. When I run the regession, I get a $\beta$ and $\alpha$ estimates, along ...
0
votes
1answer
30 views

Multiple Regression with Categorical Predictor Variables of More than Two Levels

I'm planning on running a hierarchical multiple regression in SPSS. In the first step, I would like to enter demographic characteristics, second step continuous predictor variables of interest, and ...
0
votes
0answers
12 views

Simplifying $\sum_i[z_i'(\delta-\hat{\delta})]^2x_ix_i'$ to apply a law of large numbers

I'm in the context of linear regressions. Let $n$ be the sample size and for $i=1,\ldots,n$, let $$ \underbrace{x_i}_{K\times 1},\quad \underbrace{z_i}_{L\times 1}\quad(n>K\geq L) $$ be column ...
0
votes
0answers
13 views

multiple linear regression analysis and case of p>>n

In the case for simple linear regression and multiple linear regression, if we have p >> n, is it undefined? And in the case for ridge regression, p>>n requires $\lambda$ to increase b/c more ...
1
vote
0answers
17 views

Outlier Contained in Prediction Interval (Tme series Forecasting Problem)

In my stats class today, the professor was showing us some output from MINITAB on a prediction interval that was calculated (from time series data using standard linear regression). For one of the ...
0
votes
0answers
10 views

Algorithm does not converge in R [migrated]

I am doing a logistic regression in R, where I am modeling how potholes and weather correlate to accidents. When I run a logistic regression, I get the message "Algorithm does not converge" The ...
0
votes
0answers
37 views

Inclined Elliptic Tank Volume Calculation

Can someone help me determine an equation for calculating the volume of an elliptical cylinder on it's side and inclined 5 degrees from horizontal? The tank has flat ends. I have found several ...
0
votes
0answers
18 views

If you control some variable in a regression , how would you find what proportion of the remaining variation?

If you control some variable in a regression , how would you find what proportion of the remaining variation that is explained by the controlled variable? so that is to say , we have variables x1 x2 ...
0
votes
1answer
37 views

For a general linear regression , are Y and Y hat independent?

For a general linear regression , are $Y$ and $\hat{Y}$ independent? $Y$=XB+e $\hat{Y}$=X$\hat{B}$ I think they are dependent, because if they rely on the same data, they should have some sort of ...
1
vote
1answer
23 views

Inference about the true intercept of the model and the OLS being BLUE

Consider the following population regression model: $$y_{i} = \beta _{1} + \beta_{2}x_{i} + \epsilon _{i},$$ where $i=1,...,n$. Assume $\epsilon \sim iid$, with the pdf in equation: $f(\epsilon ) = ...
0
votes
1answer
23 views

What is a common name for the resulting function?

Consider the following population regression model: $$y_{i} = \beta _{1} + \beta_{2}x_{i} + \epsilon _{i},$$ where $i=1,...,n$. Assume $\epsilon \sim iid$, with the pdf in equation: $f(\epsilon ) = ...
1
vote
0answers
10 views

derive the distribution(a multiple regression problem)

(Multiple regression model with p's predictor variables.) Derive the distribution of $$\frac{(b-\beta)X'X(b-\beta)}{MSE\cdot p}$$ As far as I know, $b\sim N(\beta,\sigma^2 (X'X)^{-1})$ $b-\beta ...
0
votes
1answer
38 views

Proving an implication in a linear regression

Suppose we have a linear regression: $$ y_i=X_i'\beta+u_i,\quad i=1,\ldots,T. $$ Here $y_i$ and $u_i$ are scalars, $X_i$ and $\beta$ $k\times 1$. $\beta$ is a (non-stochastic) vector of ...
0
votes
1answer
11 views

Conditional expectation; regression

Assume that E[$y_{it}|c_i, x_{it}$] = $c_i$ + $x'_{it}\beta$ Eliminate $c_i$ by taking the expectation with respect to $c_i$, leading to E[$y_{it}|x_{it}$] = E[$c_i|x_{it}$] + $x'_{it}\beta$ ...
0
votes
0answers
10 views

For the general linear model, what is the distribution of $C\hat{B}$? Note $C$ is $q \times (k+1)$.

For the general linear model, what is the distribution of $C\hat{B}$? note $C$ is $q \times (k+1)$. So as far as I know, the general linear model is $\hat{Y}=X\hat{B}+e$. I don't understand why the ...
0
votes
0answers
19 views

Question about regression model

Suppose you fit (estimate the parameters of) a regression model, obtaining $\hat{Y}$, $\hat{B}$, and $\hat{E}$. And you fit a second regression model , using $\hat{Y}$ x matrix from previous model ...
0
votes
1answer
28 views

how to show for a simple regression with an intercept and one independent variable$ R^2 = r ^2$ , where $r$ is the ordinary correlation coefficient.

how to show for a simple regression with an intercept and one independent variable $R^2 = r ^2$, where $r$ is the ordinary correlation coefficient. Here is where I'm at. $R^2= ...
1
vote
0answers
17 views

Regression on even function?

Is there any test for whether or not the regression function is even? Suppose we have a model: $Y=g(X, \epsilon)$, where $Y, X$ are both one dimensional. My questions is how do we test for $g$ is an ...
1
vote
0answers
31 views

The Hessian Matrix I calculate is twice as much as it should be. Why?

I have a function "fkt." In this example, let it be as simple as $y=a \cdot x+b$. I have a real dataset with values obeying to the model. After regression of the points to the model, I find the ...
3
votes
1answer
29 views

When is Block-Partitioned Matrix Invertible?

Suppose I have a block partitioned matrix \begin{equation} \begin{bmatrix} \mathbf{X}_1^{\top}\mathbf{X}_1 & \mathbf{X}_1^{\top}\mathbf{X}_2 \\ \mathbf{X}_2^{\top}\mathbf{X}_1 & ...
0
votes
0answers
4 views

Multivariate regression analyisis with grouped data. How do I 'un-group'

I am trying to determine if either of two non-numeric variables effect the percentage of people who take a specific action. There is another variable that needs to be controlled for. In real world ...
0
votes
1answer
5 views

Do multiclass logistic regressions obey Kolmogorov's second axiom?

Logistic regressions were taught to me using the intuition that they approximate $\mathbb{P}(Y=y|x;\theta)$. Multiclass regressions use one-vs-all classification, selecting one $y$ and classifying ...