For questions about estimation and how and when to estimate correctly

learn more… | top users | synonyms

41
votes
10answers
2k views

What is the fastest/most efficient algorithm for estimating Euler's Constant $\gamma$?

What is the fastest algorithm for estimating Euler's Constant $\gamma \approx0.57721$? Using the definition: $$\lim_{n\to\infty} \sum_{x=1}^{n}\frac{1}{x}-\log n=\gamma$$ I finally get $2$ decimal ...
21
votes
8answers
972 views

Mental estimate for tangent of an angle (from $0$ to $90$ degrees)

Does anyone know of a way to estimate the tangent of an angle in their head? Accuracy is not critically important, but within $5%$ percent would probably be good, 10% may be acceptable. I can ...
16
votes
3answers
354 views

Approximating $100!$

I participated in an Estimathon (a speed contest of Fermi problems) not long ago. It works as follows. Contestants are given questions and they must give a closed range $[a,b]$ which should contain ...
6
votes
4answers
226 views

A calculation that goes awfully wrong if we let $\pi=22/7$

Me and one of my friends had an argument and he said that using $22/7$ as value of $\pi$ is sufficient for any calculation. Can we always take it $22/7$, or is there some example of some calculation ...
6
votes
2answers
527 views

Is there a lower-bound version of the triangle inequality for more than two terms?

The triangle inequality $|x+y|\leq|x|+|y|$ can be generalized by induction to $$|x_1+\ldots+ x_n|\leq|x_1|+\ldots+|x_n|.$$ Can we generalize the version $|x+y|\geq||x|-|y||$ to $n$ terms too? I need ...
5
votes
1answer
127 views

Estimating a gaussian distribution from a GMM

Suppose that we have a Gaussian mixture model (GMM) in n-dimensional space: $$P_1(x) = \sum_{i=1}^{C}\pi(c_i)\mathcal{N}(\mu_i,\Sigma_i)$$ We want to estimate a single Gaussian distribution from ...
5
votes
2answers
219 views

Naively estimating the factorial

A naive way to estimate the factorial is $n! \geq (a+1) (a+2) \dots n \geq a^{n-a}$ for any $a$. For example, it gives $n! \geq (n/2)^{n/2}$ and slightly better $n! \geq (n/3)^{2n/3}$. I am interested ...
5
votes
1answer
64 views

An estimate of $C^2$

Let $u$ be a function on a domain $\Omega\subset R^n$, and $D^2u=\left(\frac{\partial^2 u}{\partial x_i\partial x_j}\right)_{n\times n}$ be the Hessian of $u$. If $D^2u$ is positively definite and ...
5
votes
3answers
4k views

Maximum likelihood estimation of $a,b$ for a uniform distribution on $[a,b]$

I'm supposed to calculate the MLE's for $a$ and $b$ from a random sample of $(X_1,...,X_n)$ drawn from a uniform distribution on $[a,b]$. But the likelihood function, ...
4
votes
1answer
244 views

Estimating the sum $\sum_{k=2}^{\infty} \frac{1}{k \ln^2(k)}$

By integral test, it is easy to see that $$\sum_{k=2}^{\infty} \frac{1}{k \ln^2(k)}$$ converges. [Here $\ln(x)$ denotes the natural logarithm, and $\ln^2(x)$ stands for $(\ln(x))^2$] I am ...
4
votes
1answer
1k views

Method for estimating the $n^{th}$ derivative?

When using numerical analysis, I often find that I am required to estimate a derivative (e.g. when using Newton Iteration for finding roots). To estimate the first derivative of a function $f(x)$ at ...
4
votes
1answer
154 views

Estimate the scale of $e^{-(m+1) t} \sum _{k=0}^{\infty } \frac{t^k}{k!}\left(\sum _{r=0}^k \frac{t^r}{r!}\right)^{m}$

I would like to estimate the scale of the following series, $$S(m,t)=e^{-(m+1) t} \sum _{k=0}^{\infty } \frac{t^k}{k!}\left(\sum _{r=0}^k \frac{t^r}{r!}\right)^{m},$$ where $e$ is the base of ...
4
votes
2answers
234 views

Bound for the Legendre function of the second kind of degree $1/2$

Let $Q_{1/2}(u)$ be the Legendre function of the second kind of degree $1/2$. One can show that $Q_{1/2}(u) = O(u^{-3/2})$ as $u\to \infty$; see Equation 21 in Section 3.9.2 of Higher transcendental ...
4
votes
1answer
87 views

My data is not normally distributed: what can I do to estimate a tail probability?

Continuing on from my earlier question, I'm attempting to analyse the data qualitatively. In the following plot, I make $10000$ samples where I count "the number of clashes". I plot $n$ vs. the ...
4
votes
0answers
239 views

A late-diverging “approximating solution” for a system of functional equations

Peace be upon you, At the end of this question, I have shown that how computing MLE on an i.i.d Beta distributed data, results in the following system \begin{align*} &\begin{cases} ...
3
votes
4answers
205 views

Using $(1+x)^k \approx 1+kx$ to approximate?

Use the approximation $(1+x)^k \approx 1+kx$ to estimate $(1.0003)^{26}$ and $\sqrt[4]{1.006}$. I know how to solve this step-by-step, but I don't understand what I'm doing exactly: why does ...
3
votes
4answers
335 views

Why does maximum likelihood estimation for uniform distribution give maximum of data?

I am looking at parameters estimation for the uniform distribution in the context of MLEs. Now, I know the likelihood function of the Uniform distribution $U(0,\theta)$ which is $1/\theta^n$ cannot ...
3
votes
2answers
2k views

Modern formula for calculating Riemann Zeta Function [duplicate]

Possible Duplicate: How to evaluate Riemann Zeta function I have an amateur interest in the Zeta Function. I have read Edward's book on the topic, which is perhaps a little dated. I would ...
3
votes
1answer
94 views

Maximum likelihood estimation - why is $\mathcal{L}$ not the joint pdf?

Here's an excerpt from my notes: Define the likelihood function: $$\mathcal{L}(\vec{x};\theta)=\prod_{i=1}^{n} f(x_i;\theta)$$ Where $f$ is the pdf of the distribution we're sampling the $x$'s ...
3
votes
2answers
84 views

Error Term in Passing from Summation to Integral

I encountered the following in a paper and do not understand how the error term is being bounded. In what follows, $n$ and $k$ are large integer constants. $$ \sum_{i=0}^{n-1} \ln\left(1 - ...
3
votes
1answer
37 views

Show that the variance is biased

I am trying to understand the proof that the uncorrected sample variance is biased (given here) $$ \begin{eqnarray} E[S^2] &=& E \left [ \frac{1}{n} \sum \limits_{i=1}^{n} (X_i - \bar ...
3
votes
1answer
34 views

Oscillations about equilibrium for coupled differentail equations

I have the following system of equations: $$\begin{align} \frac{dX}{dt} &= 2Y-2\\ \frac{dY}{dt} &= 9X-X^3 \end{align}$$ I would like to study the property of solutions to this function about ...
3
votes
1answer
656 views

What initial guess is used for finding n-th root using Newton-Raphson method?

I would like to know what is an optimal initial guess for use with Newton-Raphson method when finding n-th root. I develop some program which uses GMP C++ library. GMP manual says: The initial ...
3
votes
1answer
39 views

Why is the MLE a special case of the minimum contrast estimator?

In my statistics lecture, we had two definitions, namely Let $X_1,\ldots.X_n$ be iid random variables, each with density $p_{\Theta_0}(x)$. Furthermore, let $\varrho$ be a real function such that ...
3
votes
1answer
50 views

Estimate the given sum.

This is the question from "Data Structures and Algorithm Analysis in C" By Mark Weiss. It is the question 1.7. It goes as follows:- Estimate the sum ...
3
votes
1answer
227 views

Sufficient statistic for product of $\Gamma(x + a_i)$

Background Suppose that the national mint mints coins with bias $p_i \sim \rm{Beta}(A,B)$ for some unknown constants $A$, $B$. Given $n$ coins, you flip each coin a certain number of times. Coin ...
3
votes
1answer
96 views

Estimate large covariance matrix using few samples.

Let $\mathbf{x}$ be a random vector in $\Bbb{R}^n$, such that $\mathbf{x}\sim N(\bar{\mathbf{x}}, \Sigma)$. $N$ observations of $\mathbf{x}$ are available, say $\{\mathbf{x}_i, i=1,\ldots,N\}$. The ...
3
votes
1answer
60 views

Unbiased Estimator Question and Understanding

I'm having some difficulty with unbiased estimators, and wondered if anyone could help me. I believe I understand the general concepts OK, however when I come to look at some sample questions to test ...
3
votes
1answer
81 views

Estimating the input to a system from a system state

[ Cross-posted to: http://dsp.stackexchange.com/questions/3098/estimating-the-input-to-a-system-from-a-system-state-using-ekf ] I have a system for which I have obtained a non-linear time-varying ...
3
votes
0answers
22 views

Rao-Cramer lower bound regularity condition and dominated convergence

Let $(\mathcal{X}, \mathcal{F}, (\mathbb{P}_\vartheta)_{\vartheta \in \Theta})$ be a statistical model dominated by a sigma-finite measure $\mu$ with Likelihood-function $L(\vartheta, x)$ which is ...
3
votes
0answers
66 views

Upper bound for area of polygons

is there a formula for an upper bound for the area of a polygon, knowing the length of its edges? In the ideal situation, the answer would be a function $f_n(l_1,l_2,\dots,l_n)$ of the edges lengths ...
3
votes
1answer
61 views

Error of apprximation

Have anyone read book "Paul Glasserman Monte Carlo MIFE", it's good, but i'm stuck in chapter 6 page 341 let $$ dX_t=a(X_t)dt+b(X_t)\,dW_t $$ they said that $$ \int_{t}^{t+\Delta t}a(X_{u}) \, ...
3
votes
0answers
67 views

Asymptotic stability

we know from the theory of ODE that $\left\|\exp(tA)\right\|\leq Ke^{-\delta t}$ for $K,\delta >0$ and $t\in\mathbb{R}^+$ if the real part of all eigenvalues are strict non-positiv. My question is: ...
3
votes
1answer
100 views

Is my determination of this maximum correct?

Consider $\Omega:=B_1(0)\subset\mathbb{R}^n$ (it is the open unit ball), $\mathbb{R}^n$ is provided with the euclidean norm $\lVert\cdot\rVert_2$. Now I want to determine the following ...
3
votes
1answer
180 views

Best estimate for random values

Due to work related issues I can't discuss the exact question I want to ask, but I thought of a silly little example that conveys the same idea. Lets say the number of candy that comes in a package ...
3
votes
1answer
372 views

Determine whether a statistic is sufficient, given the probability density

Let $X_1, X_2, \dots, X_n$ be a sample of i.i.d. random variables, with density $$f_\theta=\frac{2}{3\theta}\left(1-\frac{x}{3\theta}\right) $$ for $0 < x < 3\theta$. And $f_\theta=0$ if $ x ...
3
votes
0answers
82 views

Numerically estimate $a^b$ [duplicate]

Possible Duplicate: How can I calculate non-integer exponents? What is the most efficient way to estimate $a^b$ ($a > 0$) numerically? My goal is not to use built-in math functions (like ...
2
votes
2answers
83 views

unbiased estimator in a random sample

I Have a statistic statement here which I need to decide if it's true or false Statement: "When the sample size is random, there is no way to get an unbiased estimator for the population average." ...
2
votes
1answer
113 views

Prove $ 1 \lt \int_0^1 \frac{1+x^{30}}{1+x^{60}} \ \mathrm{d}x \lt 1 + \frac{1}{30}$ [duplicate]

Possible Duplicate: How to prove $\int_0^1 \frac{1+x^{30}}{1+x^{60}} dx = 1 + \frac{c}{31}$, where $0 \lt c \lt 1$ How can I prove the estimate $$ 1 \lt \int_0^1 \frac{1+x^{30}}{1+x^{60}} \ ...
2
votes
1answer
68 views

Combining statistical distributions

I have a situation where a distribution is dependent on 2 variables, one of which follows the poisson distribution, and the other the normal distribution, and I want to establish the method of ...
2
votes
3answers
135 views

Estimating the series: $\sum_{k=0}^{\infty} \frac{k^a b^k}{k!}$

Any idea on how to estimate the following series: $$\sum_{k=0}^{\infty} \frac{k^a b^k}{k!}$$ where $a$ and $b$ are constant values. Greatly appreciate any respond.
2
votes
1answer
31 views

How to estimate the lower bound of a given Toeplitz matrix's eignvalue?

A given Toeplitz matrix is $$\left( \begin{matrix} 1 & a & a^2 & \cdots & a^n \\ a &1 &a & \cdots & a^{n-1} \\ a^2&a & 1 & \cdots& \cdots ...
2
votes
2answers
95 views

What's the best strategy to count the eggs in the jar?

It's Easter time, and in my workplace we have a "Count the eggs in the jar!" kind of game. What would be the best mathematical strategy to get as close as possible to the correct count? Update: ...
2
votes
1answer
58 views

Expectation of the MLE $e^{-\frac{1}{\overline{X}}}$

I am having a bit of a problem with examining the properties of a maximum likelihood estimator. I feel like I am missing something simple, but I have been unable to find someone doing an example quite ...
2
votes
1answer
88 views

Does $\operatorname{MSE}(\hat{\theta}) = \operatorname{Var}(\theta)+ \left(\operatorname{Bias}(\hat{\theta},\theta)\right)^2$?

We know that $\operatorname{MSE}(\hat{\theta})=\operatorname{E}\left[(\hat{\theta}-\theta)^2\right]$ and $\operatorname{MSE}(\hat{\theta})=\operatorname{Var}(\hat{\theta})+ ...
2
votes
3answers
56 views

Series evaluated to $m$ terms, approximating the error

Given a series $\displaystyle\sum_{n=0}^\infty a_n$, how can we bound the error (which I shall denote with $R_n$) when we evaluate it to $m$ terms? $$\sum_{n=0}^\infty a_n \approx \sum_{n=0}^m a_n$$ ...
2
votes
1answer
241 views

Bayes Estimator

Let $X_{1},...,X_{n}$ be a random sample of size n from the continuous distribution with pdf: $f_{X}(x|\alpha,\beta) = ...
2
votes
1answer
288 views

How does this calculation of $\int_0^\infty(\sin^2x)/x^2\ dx$ work?

I'm having trouble with two steps in a calculation of $$\int_0^\infty\left(\frac{\sin x}{x}\right)^2\ dx$$ in a book. They take the contours $C_R$ composed of upper half-circles ...
2
votes
1answer
1k views

How to efficiently estimate quantile function of Gamma distribution

I have an application that analyzes datasets comprised mostly of samples from a Gamma distribution. Mixed in with the data are an unknown number ($>= 0$) of outlier samples (which are actually taken ...
2
votes
1answer
40 views

Obtaining this estimate

How do I obtain this following estimate: $$\max_{0\le t \le T} \| \mathbf{u}(t) \|_{L^2(U)} \le C(\|\mathbf{u}\|_{L^2(0,T;H_0^1(U))}+\|\mathbf{u'}\|_{L^2(0,T;H^{-1}(U))}), \tag{10}$$ the constant ...