Questions on the use of mathematical techniques to extract properties from given data. Consider if your question might be more suited for Cross Validated (stats.SE) instead.

learn more… | top users | synonyms

0
votes
1answer
26 views

How to visualize change over time of multiple items at once?

I'm writing a recommendation system for a news website. At any point in time, there are between 50-100 articles that are candidates for recommendation based on the algorithm, etc. What I'm trying to ...
1
vote
1answer
24 views

How to find an equation that describes a non-linear correlation of multiple parameters

I tried to search for this problem but I don't know what exactly I'm looking for. I found some empirical parameters that correlate but not linearly. An example follows: $Y_1$ and $Y_2$ are the values ...
1
vote
1answer
30 views

Unable to comprehend results of principal component analysis

(Image below) Image shows the principal component analysis of two points {(1,3), (3,1)}. u1 and u2 are drawn which are corresponding eigenvectors after PCA. The points follow a normal distribution N(0,...
-1
votes
0answers
26 views

Finding the area under a 5th degree polynomial curve given the polynomial fitting?

Using an outdated graphing program, I have a 5th degree polynomial fitted curve for my data (protein level in a treatment). I would like to find the integral of the curve given I only have the 'p0-p5' ...
0
votes
0answers
5 views

How can I interpret joint and conditional entropies?

Say I have three variables, X,Y, and Z. Joint Entropy of X and Y is greater than joint entropy of X and Z, what does it mean? and Similarly, conditional entropy of X and Y is greater than conditional ...
1
vote
0answers
24 views

Probability distribution database

Is there some kind of probability distribution database? Very often I'm faced with a problem of fitting a distribution to data. And it also happens very often that exponential-looking data doesn't fit ...
0
votes
0answers
8 views

RMSE for shifted series

I am facing the problem to compare a series of simulations to a set of observations. Normally I would employ the Root Mean Square Error (RMSE) as goodness-of-fit measure to understand which is the ...
1
vote
0answers
18 views

Is there a tool for finding invariant features on data?

I don't know how to make a specific question, because that's what I don't know and I'm asking for. I don't even know what tags should I put on this question. If I knew, I would have the answer. I ...
0
votes
0answers
19 views

How generic is the “Unix file permission” algorithm?

In data analysis tasks, binary variables are usually encoded as $1$s and $0$s. In data sets with multiple binary variables, it is often necessary to create "interactions" of binary variables that can ...
0
votes
0answers
14 views

What is KL-Divergence? Why Do I need it? How do I use it?

I am currently studying KL Divergence. But It seems very confusing that I don't maybe understand why do I ever need it and what is that for? As I have been reading stuff about Mutual Information, it ...
0
votes
1answer
14 views

Discrete data, indepedence etc.

I'm trying to understand something that might seem basic to some but its really screwing with my mind. Imagine a set of $N$ observations of 2 variables. One variable $L$ is one of $A,B,C$ and one $I$ ...
1
vote
0answers
18 views

What methods can I use to model a seemingly chaotic set of values? [closed]

If I have a graph/set of data, what methods can I use to model the data to predict a likely next set of values? For example, given the following numbers [ 2, 4, 5, 2, 1, -1, -2, 0 ], are there some ...
0
votes
0answers
34 views

Model for headphone quality as a function of price

I've looked for any mathematical model that shows headphone quality as a function of the price of the headphones, but have not found anything yet. Of course, "quality" is quite subjective, which could ...
0
votes
0answers
29 views

Prediction for time series

Suppose we have several weeks (say, 30) in a row and number of advertisements sent on e-mails on each week and number of the following orders of the product. How can I estimate the necessary number ...
0
votes
0answers
23 views

data compression average number of bits

consider the following data file. AAACAAABAAACAAADAAAE implement a Huffman code to compress this file. What is the average number of bits per symbol?
0
votes
0answers
8 views

How to make a covariance matrix from multiple observations of different objects?

I have $N$ objects. From each object, I sample $M$ values $(x,y)$ like so: ...
0
votes
1answer
36 views

Creating Formula from Data Series

I have a power-law-ish data series and need to back my way into a formula for it, such that it can be generated for any number of points. This is the n=20 version (value rounded to nearest 0.25). ...
1
vote
1answer
25 views

Best fit with unknown functional form

I have data from a simulation of a certain function $F(x)$ for a discrete set of values $\{x_i\}$. I know that $$F(x) = A \ f(x) + B \ g(x)$$ where $A,B$ are (real, positive) constants and $f,g$ ...
0
votes
3answers
74 views

Meaning of mathematical symbol $\pm$

What is the meaning of the $\pm$ symbol in relation to this expression? For example, the perceived area of a circle probably grows somewhat more slowly than actual (physical, measured) area: $$ \...
1
vote
0answers
22 views

Comparing the task complexity of installing three different offenses for American style football in three days

I want to identify the inherent difficulty of installing three separate American rules football offenses by their complexity of practice schedules in three days then relate those offenses back to one ...
0
votes
0answers
6 views

Plot large high dimensional dataset

I have a high dimensional dataset (12 variables) with 42000 observations. I made a clustering and i have evidence to choose five cluster.So i want to plot with some tools my dataset to show (if it is ...
1
vote
1answer
16 views

Relationship between subset medians and the median

Suppose we have a set of data $A = \{a_1, a_2, \dots, a_n\}$ and $B = \{b_1, b_2, \dots, b_n \}$. So there are $2n$ elements in total. Further suppose the median of $A$ and $B$ is $a$ and $b$, ...
1
vote
0answers
129 views

Optimizing Overwatch Team Composition by Player Hero Preference [closed]

I am wordy by nature - my apologies. My attempt at a TL;DR - I want to design a small tool that optimizes the team composition of a video game based on minimizing the sum of provided player ...
0
votes
0answers
13 views

how to produce data for filtering (specifically ekf and ukf)? -or- can you supply me with data?

I am currently implementing Kalman filters (I have EKF and UKF) and need some data to test my codes in matlab. I have a set of samples I used, but I need more. How do i produce more data? Say I wrote: ...
0
votes
0answers
10 views

Validate a trained system

I had trained a system to detect some features from a set of scenarios. Now it can detect and classify that set. How to validate that system work in real world? What mathematics tools should i use?
0
votes
1answer
25 views

Hypothesis testabout the variability of 2 Samples

The hydrocarbon emissions are known to have decreased dramatically during the 1980s. A study was conducted to compare the hydrocarbon emissions at idling speed, in parts per million (ppm), for ...
0
votes
1answer
26 views

What is the difference in how $\mathrm{R}^2$ and $\mathrm{R}$ values are interpreted?

In statistics, there is the $\mathrm{R}$ value for the product moment correlation coefficient and the $\mathrm{R}^2$ value for the coefficient of determination. In both cases they are described as a ...
0
votes
1answer
39 views

Snakes and Ladders and Sample Space

for my Data class project we had to play a board game and do an analysis of it. My group chose rehashed version of Snakes and Ladders. I am almost done the majority of the project, but am stuck on ...
0
votes
1answer
17 views

Using a continuous function to describe discrete data

I've always been told to use discrete functions with discrete data and continuous functions with continuous data. This especially comes to light when talking stats and people emphasize the difference ...
0
votes
1answer
22 views

Calculate confidence interval when only given alpha?

Is there a formula to properly calculate the confidence interval when you're only given alpha and sample data? Thanks!
0
votes
0answers
9 views

Estimate Results From a Database

I have some data in an Excel document, from differents projects i've made. Now I would like to use this data in order to estimate the results for new projects with different input values. Each ...
1
vote
1answer
32 views

Type 2 Error Question - How to calculate for a two tailed?

The modulus of rupture (MOR) for a particular grade of pencil lead is known to have a standard deviation of 250 psi. Process standards call for a target value of 6500 psi for the true mean MOR. For ...
0
votes
1answer
40 views

How to prove MLE of theta is unbiased?

Let $X_1, X_2, . . . , X_n$ be a random sample from a uniform distribution on $[0, \theta]$. Suppose results $x_1, x_2, . . . , x_n$ are observed. Since $f(x) = 1/\theta$ for $0 \leq x \leq \theta$, ...
0
votes
1answer
37 views

Uniform Distribution Question - Help Needed

Let $X_1, X_2, . . . , X_n$ be a random sample from a uniform distribution on $[0, \theta]$. Suppose results $x_1, x_2, . . . , x_n$ are observed. Since $f(x) = 1/\theta$ for $0 \leq x \leq \theta$, ...
0
votes
0answers
24 views

Numerical Analysis Stability or Condition

Im not sure if its the right place to ask this question since it may be more of an informatics problem and I apologize if its the case: I want to evaluate a certain function, $\frac{log(cos(x))}{x}$ ...
-1
votes
1answer
48 views

Conditional Probability of a group of Mice

There are six female and four male mice in a group of 10. One of the female mice and two of the male mice have a particular disease. Suppose that two mice are selected at random from the group without ...
0
votes
1answer
20 views

Predicting values based on given data

num value 8 ? 10 ? 12 24.33 16 22.5 20 22.29 24 22.41 28 22.55 32 ? 36 ? let's say i have the following ...
0
votes
0answers
20 views

Can I use the dispersion index for a variable that is NOT normally distributed?

If I have a variable graphed as a function of time, that is not normally distributed, does it make sense to use its (time-varying) dispersion index, $\mathrm{Var}(x)/E(x)$ to compare its volatility ...
0
votes
0answers
3 views

Show that the maximum of a function is achieved in one of the data

I'm new to data analysis, and started working with circular data. Let $t_1,\dots,t_n\in [0,2\pi\rangle$. If we want to find the representative of the data on the unit circle, we must maximize the ...
1
vote
0answers
26 views

Relationship between eigenvectors of correlation and covariance matrices

For the purpose of computing principal components of a dataset, represented as matrix $X$ of dimensions $n \times p$ with $n$ samples and $p$ features, we can compute sample covariance matrix $S$, and ...
0
votes
0answers
10 views

Understanding the bound given by Johnson–Lindenstrauss lemma

Here I choose to use the statement made by S.Dasgupta: For any $0<\epsilon<1$ and any integer $n$, let $k$ be a positive integer s.t. $$k \geq 4(\epsilon^2/2-\epsilon^3/3)^{-1} \ln n $$ Then ...
0
votes
0answers
12 views

Curve fitting: How to identify the appropriate function for a beat-like phenomena?

I have a time series data which shows some beat like behaviour. The envelope does not look exponentially decreasing, as it is impossible from a physics point of view. The envelope is likely to be a ...
0
votes
0answers
17 views

Getting a feel for the Normal-Inverse-Wishart conjugate prior to multivariate normal distribution

I am trying to get a feel for the Normal-Inverse-Wishart conjugate prior, which I have started to use, sparingly, in my work, where I am trying to cluster multivariate normal data. As Wikipedia ...
1
vote
0answers
33 views

Spectral relaxation of k-means clustering

I am working on a presentation on Spectral relaxation of k-means clustering (http://papers.nips.cc/paper/1992-spectral-relaxation-for-k-means-clustering.pdf) and I am a bit stuck. I understand ...
1
vote
1answer
68 views

Tropical geometry: practical applications?

In 1960, E. Wigner published a paper entitled "The Unreasonable Effectiveness of Mathematics in the Natural Sciences". Theoretical mathematical structures pave the way to further advances and ...
0
votes
0answers
17 views

What is trend analysing

Hi I'm just started learning DFA for stochastic processes and I faced to the "trend".I've looked around the internet about trend analysing but still I don't understand it completely.can you define "...
0
votes
0answers
13 views

likelihood function when data and model share a common parameter

I'm having some conceptual difficulty with how to describe, and deal with, a problem related to constructing a likelihood function that will be used to fit a model to data. Sorry in advance if I ...
1
vote
1answer
19 views

Alternatives to Shephard interpolation?

I am a chemist, so I have little experience in the field of math. My program is that I have a set of points (approx. 20000) in some larger dimensional space (like 10-20 dimensions), and I want to be ...
1
vote
1answer
28 views

How to prove convergence of a sequence maximizing a sum of exponential distances?

I want to find the argument $x$ that maximizes $f(x)=\sum_i e^{-(x-d_i)^2/c}$ for some data values $d_i$ and an arbitrary positive constant $c$. I assume that $f(x)$ has only a single maximum (most ...
0
votes
2answers
31 views

How can I determine the best relationship for 3 variables, given several data points?

What is the best way to determine the relationship for three apparently related variables? The relationship does not appear to be linear, and may follow a combination of non-linear functions. I have ...