Questions on the use of mathematical techniques to extract properties from given data. Consider if your question might be more suited for Cross Validated (stats.SE) instead.

learn more… | top users | synonyms

1
vote
0answers
35 views

How to find BUE of N? where $X_i$ iid $ P(X_i=j)=1/N$, for $j=1, \cdots, N$

Let $X_1, \cdots, X_n$ be iid with $P(X_i=j)=1/N$, for $j=1, \cdots, N$, where $N$ is an unknown positive integer. I would guess that the order statistics $X_{(n)}$ is the complete sufficient ...
0
votes
0answers
18 views

Linear trend has to pass through a point [duplicate]

Possible Duplicate: Linear trend has to pass through a point I need to interpolate a linear trend surface through a number of points but with the condition that the surface has to pass ...
0
votes
0answers
154 views

Test of goodness of fit - normal distribution of file sizes on HDD

I'm trying to prove, that sizes of files stored on HDD comes from normal distribution. I already made a java code that gave me list of all files on disk with filesizes in Bytes: ...
2
votes
1answer
388 views

Data Type Classification in Statistics

It is my understanding that in statistics one has 4 basic data types: nominal, ordinal, ratio, and interval. I see cases where people refer to "count data" (which is a random variable whose range is ...
0
votes
4answers
312 views

Can you help me solve these questions related to a Logical theory?

In a group of 200 people, number of people having at least primary education (assuming - Category I): number of people having at least middle school education (Category II): number of people having ...
0
votes
1answer
74 views

Determining Sample Size - Design Problem

I have a hypothetical problem were say I have a sample size of about 5000 people. I then will collect data on them say, how man calories of food they eat per day for a month. Now I can't obviously run ...
1
vote
1answer
117 views
0
votes
1answer
83 views

algebraic expression for a counting function

consider a 2d "counting" function given by the $(x,y)$ points/pairs: (1,1), (2,2),(3,2), (4,3),(5,3),(6,3), (7,4),(8,4),(9,4),(10,4), (11,5),(12,5),(13,5),(14,5),(15,5), ... ie $x$ increments in ...
9
votes
3answers
359 views

Removing noise when the signal is not smooth

Suppose we have (an interval of) a time series of measurements: We assume it can be explained as a "simple" underlying signal overlaid by noise. I'm interested in finding a good algorithm to ...
0
votes
1answer
66 views

What is the name of this data normalization?

I have a two-dimensional array ($569\times30$ double) which should be normalized using this formula: $x'_{ij} = \dfrac{x_{ij} - \overline\mu_j}{\overline\delta_j} $ What is the name of this ...
0
votes
1answer
67 views

Finding outliers in a linear series

I have a series of observations made against time. Given perfect observations, the trend should be reasonably linear. As I expect there to be measurement errors, I wish to exclude them from further ...
1
vote
1answer
312 views

Error in a numerical derivative

I have a graph of data, say temperature ($T$) vs time($t$), I know the error bounds in each $\Delta T$. The range of t is from 0 $\to$ 1600 s, with small steps say 0.001 s. If I numerically take ...
0
votes
1answer
65 views

Determine a curve's dominant direction over time

I have a sequence of numbers in a certain order, for example {60,61,62,1,63,,64,102,65,66,200} If this is drawn as a graph, this will be a curve going upwards, but with some aggressive jumps upwards ...
1
vote
2answers
1k views

What is the distribution of a data set

I understand what the probability distribution is. I also have a personal understanding/interpretation of the concept of distribution of a dataset. Whenever I see this expression I imagine a graph ...
5
votes
1answer
526 views

Abstract Algebra for Business Intelligence / Data Mining

Twitter released its Algebird library, an abstract algebra library for scala. At a high level, what are the maths involved in abstract algebra that have an impact on aggregating large datasets?
3
votes
2answers
104 views

How do I use specific data points on a graph to determine an equation?

I need to find a function $f(x)$ such that the following data points would fit on it: $$f(1) = 0 \\ f(2) = 0.5 \\ f(4) = 1.0 \\ f(8) = 1.5 \\ \cdots $$ and so on. So the pattern is every time $x$ ...
0
votes
1answer
134 views

Microsoft Excel not graphing, $x = y^{1/2}$

Im not sure if this is a math question or a su question. The experiment was relating the period of one "bounce" when you hang a weight on a spring and let it bounce. I have this data here, one ...
1
vote
0answers
44 views

Fitting multiple functions with shared parameters to data

consider a set of real-valued continuous functions $$f_i(t;a)$$ for $1\leq i\leq n$ with some shared non-negative parameters $a=(a_1,\ldots,a_d)\in\mathbb{R}^d$. Furthermore, assume that there exists ...
1
vote
2answers
116 views

Finding an equation to fit data points

I'm a software developer by trade and one of the things I did today was recursively generate some dummy data for a tree. I used two parameters in my recursive algorithm: number of levels and number of ...
1
vote
0answers
87 views

Filter/Removal of periodic 'delta-peaks'

Currently I am measuring data (Counts over Time). Due to measurement problems I have some nasty peaks in this data. These peaks are periodical, very sharp (~3 datapoints over a range of 10000) and ...
2
votes
1answer
94 views

What's the best function to use to fit this data?

{7502, 6610, 4988, 2861, 2242, 1746, 1433, 1312, 949, 793, 767, 664, 660, 653, 588, 578, 575, 572, 553, 500, 445, 418, 374, 165, 108} I was looking at the number of seeds for torrent files for ...
0
votes
1answer
47 views

arctic sea ice data by year

I want to demonstrate the usefulness of regression lines to my class, and I was hoping to do so with some data about the Arctic sea ice. What I'd like is the maximal area covered by the ice per year, ...
1
vote
1answer
65 views

Variable frequency redistribution

I know that there is a way to "redistribute of the frequencies of a variable" as stated here: Dorian Pyle book chapter 7 section 2 paragraph 3 (7.2.3): The easiest way to adjust distribution ...
3
votes
1answer
188 views

Fitting a surface to 2D measurements

I am looking for a way to fit a surface given a set of measured data $(x, y) \mapsto z$. A typical example would consist of anywhere between $10$ and $30$ measurements spread evenly over a disc. ...
0
votes
1answer
286 views

Given a set of data (distance vs time) obtain a closer approximate for velocity

This is actually a physics experiment. I've collected a set of data Distance and time it takes for a cart to move down an incline plane. From here, I've calculated the average time (...
1
vote
1answer
1k views

Standard Deviation vs Standard Error

I am confused about the difference between standard deviation and error. When do I use which? From my lecture: Standard deviation quantifies spread of data about mean Standard error measures spread ...
1
vote
1answer
76 views

What preposition to use when fitting data?

Please could some real experts give an opinion on this question on English.SE: What preposition to use when fitting data? Do we fit data with, by, or as a linear function? Forgive me as I do ...
11
votes
4answers
2k views

Mathematics base for data mining and artificial intelligence algorithms. [closed]

Could you give me some clarification about data mining and artificial intelligence algorithms? What mathematics base they used for? Could you give me starting point, in mathematics, to understand ...
1
vote
1answer
204 views

Html Tag counting - Rate of Change formula

I've been trying to a find a statistics-esque formula for calculating the rate of change for html tags which are either added or removed from various websites. So, for example, with the scraper I'm ...
0
votes
1answer
3k views

How to perform simple linear interpolation on a data set

With the following data set, what is the best way to interpolate the data for each time. ...
1
vote
0answers
51 views

How to quantify the volitility of a time series data?

I am currently working on a time series data and I would like to quantify how volatile it is. Here volatile I mean how "shaky" the series is. If the series is smooth than it is not volatile. I have ...
1
vote
0answers
301 views

How should I calculate “fill rate”? People inquire about an item and then buy it days/months later?

So I have posts(people posting a want for an item) and then I have fills(the person actually getting the item) There are hundreds of posts per day but the fill for that item can be days or weeks away ...
1
vote
1answer
257 views

Equal interval data classification technique formula confusion

The formula for breaking a sequence of values into groups of equal ranges is: max - min / number of categories I would like to know why is it necessary to subtract the maximum value from the minimum ...
1
vote
1answer
176 views

How to create function that is a power law

If I have a starting and ending y value and know the range along the x-axis, how can I create a function that adheres to a power-law? Ex: I want the function to start at (1, 10), end at (1000,0). ...
1
vote
0answers
99 views

Jacobian approximation at given point without explicit derivatives expression

after solving a NLproblem with optimization method, I would like to compute confidence intervals, prediction bounds and standard deviation for these optimal parameters. Explicit formulas I have read ...
0
votes
2answers
70 views

Normalize $X$ to $0$ to $10$ scale with asymptotes at either end

I am trying to find a scaling function that mimics the gas gauge in a car. I would like to map a value to a $0$ to $10$ scale, on which I have two known points. For example: $X_1 = 2$, $Y_1 = 2.5$, ...
1
vote
1answer
1k views

time derivative of discrete data in simulink

I'm implementing a program in Java that was delivered in Simulink. My expertise is limited, and I'm stuck on converting a derivative block. The simulink code applies a du/dt block to the input data. ...
0
votes
1answer
330 views

Calculating number of draws in a series of team matches

May be this could be an easy problem but somehow cannot arrive to any conclusive result to this indecisiveness problem For a certain number of teams ($n$) playing a series of matches ($m$), and given ...
2
votes
2answers
143 views

Working out the “best” score based on quantity and ratio

I'm not an expert with mathematics so I hope I'm posting in the right place! I've got a lot of products which can be rated good, bad and OK by a user. What I'm having trouble with is finding which is ...
1
vote
3answers
168 views

'Squashing' a graph of data?

I have a vector of sample data that describes a divergent oscillation like in this image. I want to transform this data (just the data, not the system or anything), so that the data does converge ...
0
votes
1answer
207 views

How do i estimate an equation of best fit of a sort-of exponential equation given it's points?

There is an unnessarly long table of values of an item in a game that grants experience to a player based on one's level in the chosen skill. I think it would be much more appropriate to cite the ...
1
vote
3answers
625 views

Find parameters for exponential function fitting to datapoints

I have a set of datapoints, in this case the temperature of an object adjusting to the environment temperature over time. Because I know these kind of processes take the form of $$f(x)=Ae^{x/B}+C$$ I ...
0
votes
2answers
86 views

preliminary evaluation for forecasting models

Suppose I would like to use a method for data prediction, and that I have some empirical data (i.e., sequence of samples of the form [time, value]). Would it be possible to know in advance, based on ...
1
vote
1answer
82 views

Waveform filter - what's in the black box?

I'm trying to come up with an algorithm or filter that has the i/o characteristics in the image below (waveform plotted from audio data) .. I input a sine wave or saw and the resulting graphic is an ...
1
vote
0answers
33 views

How to symmetrically adjust data by removing certain value

Say I have a data set in the following format: {a:200, b: 100; c:400} The sum of a, b and c equals 700. Now, I have another value which is supposed to be the actual total say 500. How do I adjust ...
0
votes
1answer
50 views

Graphically representing low number of infractions against high activity volume

I have been presented with a dataset that looks at work volume and safety infractions. A sample table: A sample chart: The issue we are having is trying to graphically represent it so that ...
0
votes
0answers
381 views

how to calculate a curvature/angle of best fit line segments

I have data points from a power spectrum (fft) output that look like the image below. A characteristic of the data seems to be a heavy slope and then a flattening out. I would like to be able to ...
1
vote
1answer
972 views

Understanding a Density Plot

I am currently plotting density plots in R to view the distribution of my data. An example density plot is here I understand N is the number of values in the data set and bandwidth is the the ...
3
votes
3answers
260 views

What would this curve be called?

In an resistor-capacitor circuit, the voltage stored is measured by taking the two values in Farads and Ohms - and the curve looks like this: What would this curve be called, logarithmic? ...
0
votes
1answer
126 views

Fitting two separate curves to a graph consistently?

I have a set of graphs with a large primary peak and a secondary peak that intersects the first and I want to fit two curves (one per peak) and find the point at which the two curves intersect for ...