Questions on the use of mathematical techniques to extract properties from given data. Consider if your question might be more suited for Cross Validated (stats.SE) instead.

learn more… | top users | synonyms

11
votes
4answers
2k views

Mathematics base for data mining and artificial intelligence algorithms. [closed]

Could you give me some clarification about data mining and artificial intelligence algorithms? What mathematics base they used for? Could you give me starting point, in mathematics, to understand ...
11
votes
4answers
4k views

Polynomial fitting where polynomial must be monotonically increasing

Given a set of monotonically increasing data points (in 2D), I want to fit a polynomial to the data which is monotonically increasing over the domain of the data. If the highest x value is 100, I don'...
9
votes
3answers
758 views

Removing noise when the signal is not smooth

Suppose we have (an interval of) a time series of measurements: We assume it can be explained as a "simple" underlying signal overlaid by noise. I'm interested in finding a good algorithm to ...
8
votes
2answers
2k views

Where to start learning about topological data analysis

I was wondering if anyone could help me out with finding a nice introductory introductory text for topological data analysis (I'm speaking as somebody who has two semesters of experience with topology,...
7
votes
5answers
371 views

Finding the orientation of a noisy ellipse

This question comes from a neuroscience study which generates $12$ vectors. The vectors are evenly spaced, $30 n$ degrees for $n=0,\dots, 11$, each with their tail centered on the origin. I am ...
5
votes
2answers
21k views

Value range of normalization methods? min-max, z-score, decimal scaling

I am working my way through Normalization (data transformation) of data and was curious about four methods: min-max normalization, 2. z-score, 3. z-score mean absolute deviation, and 4. decimal ...
5
votes
2answers
174 views

Highest points in heart cycle graph

I'm making an application that reads the heart cycle from a device, and I've aimed to get this image: Now, I need to get the highest points that appear in every cycle in order to calculate the ...
5
votes
2answers
183 views

Chaos theory and fractal geometry: Constructing from data

I understand that fractal geometry represents behaviour of 'chaotic' system, if I am not wrong. And also, fractals are generated by a recursive function. But, lets say I have random data lying with me....
5
votes
4answers
270 views

Testing for chaos in data

I have data for 3 variables ,each with respect to the discrete time values. How do I check for the existence of chaos for this 3D discrete system?(I don't have the analytic eqs.,just the data). MY ...
5
votes
1answer
842 views

Abstract Algebra for Business Intelligence / Data Mining

Twitter released its Algebird library, an abstract algebra library for scala. At a high level, what are the maths involved in abstract algebra that have an impact on aggregating large datasets?
4
votes
2answers
836 views

Way to compare three numbers with an algorithm.

Say I have values 10, 3, 6 What would be a way of finding a subjective difference between them. Or in other words, how close they are to each-other. So if i had 3, 2.5, 2.8; they would be close ...
4
votes
3answers
934 views

What would this curve be called?

In an resistor-capacitor circuit, the voltage stored is measured by taking the two values in Farads and Ohms - and the curve looks like this: What would this curve be called, logarithmic? ...
4
votes
2answers
185 views

Detecting increasing pulse trains

I have a one dimensional point process representing the times of events which is also mixed in with lots of data that I regard as noise. The interval between the events in the point process are ...
4
votes
1answer
284 views

Fitting a surface to 2D measurements

I am looking for a way to fit a surface given a set of measured data $(x, y) \mapsto z$. A typical example would consist of anywhere between $10$ and $30$ measurements spread evenly over a disc. ...
3
votes
2answers
566 views

Difference between Topological Data Analysis and Graph Technology

I'm trying to understand the difference between Oracle's graph technology, which apparently has an inherent understanding of topology, and Ayasdi's Topological Data Analysis technology. Are these two ...
3
votes
2answers
159 views

How do I use specific data points on a graph to determine an equation?

I need to find a function $f(x)$ such that the following data points would fit on it: $$f(1) = 0 \\ f(2) = 0.5 \\ f(4) = 1.0 \\ f(8) = 1.5 \\ \cdots $$ and so on. So the pattern is every time $x$ ...
3
votes
2answers
72 views

Need to find function by the data

I have found interesting sequence, but I can't find its function. Here are the input and output data: ...
3
votes
2answers
202 views

Power set of a set containing a set

I need some help understanding this concept a little better. I understand the general power sets, but only worked nice and easy examples where only the set consisted of only single elements like $\{a,...
3
votes
1answer
107 views

Is topological data analysis useful for low dimensional data?

I often read how Topological Data Analysis (TDA) is useful especially for highly dimensional data. But, what about (apparently) low dimensional ones? Example: consider measuring the resistance of a ...
3
votes
1answer
28 views

Median of Medians

Given a set A with median Am = 10 and set B with median Bm = 20 is it true that the median of the combined set C is $10 \le$ Cm$\le 20$ ? My first thought was that this wasn't true so I tried to find ...
3
votes
2answers
65 views

What is the chance of a sample in white noise to be a local extremum?

I draw a long sequence of values from a uniform or normal distribution. Observing the resulting sequence, what is the chance of any point in the sequence (aside from the first and last where it is not ...
3
votes
1answer
74 views

Calculate trend and represent in text?

First off, I'm terrible at math. I'm writing a script that monitors transactions from clients daily over a 7 day period. Given a set of numbers like below, I would like to calculate a trend and ...
3
votes
2answers
49 views

How to pick the “best” line equation that fits data and passes through the origin?

I have some data shown in the image. Each symbol corresponds to a different dataset. As it can be seen the data initially behaves like a line and after some points it follows other behaviour. The ...
3
votes
2answers
54 views

Inversion of the Burrows Wheelers Transform

The "Burrows-Wheeler Transform" in signal processing is a transformation which is used in for instance data compression and pattern recognition. It can be described in mathematical terms as: Start ...
3
votes
1answer
270 views

Sigmoid function with separate control of derivative at 0 and sharpness of bend.

For a physical relationship, $f(x)$, I'm trying to model, i have a fairly good determination of some of the boundaries, such that $ f(0) = 0$ $f'(0) = B$ $ \lim_{x\to\infty} f = A $ So far, what I ...
3
votes
1answer
63 views

The number of nuts in a package of “Premium Cashews” is normally distributed with a mean of 433 and a standard deviation of 6 nuts.

The number of nuts in a package of "Premium Cashews" is normally distributed with a mean of 433 and a standard deviation of 6 nuts. Packages with fewer than 420 nuts or more than 445 nuts will be ...
3
votes
1answer
1k views

How do I 'reverse engineer' the standard deviation?

My problem is fairly concrete and direct. My company loves to do major business decisions based on many reports available on the media. These reports relates how our products are fairing in ...
3
votes
1answer
21 views

Where can I find a longitudinal study with a binary response?

I've spent the last couple of months trying to find real data (not simulated) of a longitudinal study, but I can't seem to find one. Any topic and time frame is fine, but the dependent variable must ...
3
votes
1answer
302 views

Lloyd's algorithm in normed vector spaces

How do I run Lloyd's algorithm in a normed vector space? The space: L*a*b* color space, finite sRGB segment, $R^3$ The distance metric: CIE94 using L*C*h* information derived from the L*a*b* ...
3
votes
1answer
27 views

Clustering elements according to covariance matrix

I'm doing a little bit of topic modelling (which is not really my area) with twitter tweets. The situation is the following: I have a (sort of) covariance matrix where the entrie $C_{ij}$ corresponds ...
3
votes
0answers
396 views

How does 2D kriging interpolation work?

I have a grid of points Example ...
3
votes
0answers
56 views

Find spikes in data

I have some datasets and I need to find spikes in them. Imagine the data looks like trading data. If the spike is big enough, I need to log it, otherwise, proceed in the analysis. I tried with a ...
3
votes
1answer
238 views

Logistic functions - how to find the growth rate

We have the formule for a model with logistic growth: $$ N_t = N_{t-1} + g\, N_{t-1}\left( 1 -\dfrac{N_{t-1}}{K}\right)$$ where $g$ defines the growth rate and $K$ is the carrying capacity. Let's ...
2
votes
2answers
67 views

Converting data to a specified range

I am trying to convert data to a particular range of 0-10. Actual Data may vary from - 50000 - 26214400. I have broken this down in to 4 parts as follows - ...
2
votes
2answers
34 views

Is this histogram considered bimodal?

Is this histogram bimodal? Because when I google what a bimodal histogram looks like, I keep getting images that say histograms like these are considered bimodal. Isn't it unimodal because the ...
2
votes
3answers
99 views

$4\log_2(n)=n$ How to Solve for $n$?

As the title suggests, my log skills are pretty lacking. Need to learn how to get from $4\log_2(n)=n$ to $n=16$ ($\log$ base $2$). I've searched Google and it seems I am missing some core concept here....
2
votes
2answers
15k views

Use a set of data points from a graph to find a derivative

I have a data logger that is recording the temperature readings from thermocouples at a specific interval. This gives me data points that I can graph where the x-coordinate is time and the y-...
2
votes
1answer
12k views

Boxplots and bar graphs

I'm studying for the GRE and came across several questions that I was unable to answer in a practice booklet, even after looking at the answer and trying to work backwards, and searching google and ...
2
votes
5answers
59 views

Prove a function is in Big-Oh and not in Big-Omega

We are told to use the definitions of Big-Oh and Big-Omega to prove that a given function is in $O(f(n))$ or $\Omega(f(n))$. It requires being able to use $c$ and $n_0$. Use the definitions to show ...
2
votes
1answer
23 views

Extrapolate data points from a series of averages

Given a series of data points: $$\begin{array}{c|c|c|c|c|c|c|c|} & \text{Monday} & \text{Tuesday} & \text{Wednesday} & \text{Thursday} & \text{Friday} & \text{Saturday} &...
2
votes
2answers
107 views

weighing avg by columns vs rows outputs different results

First of all, I just know the basics of math, so please be patient. I have an overall score for a company with the product1 and product2. However when I do the overall for each criteria like ...
2
votes
1answer
423 views

Analyzing data to determine seasonal indices?

The quarterly sales levels for the past four years of a leading tyre manufacturer are displayed on the table table How to analyze the data to determine the specific seasonal indices,and what ...
2
votes
1answer
1k views

Is there a scientific way to assign weights to historical data?

This is a common question I usually face while processing historical data. I have year on year data of an event for the past N years.I would like to assign weights to the data of these N years so that ...
2
votes
1answer
214 views

Find data to perform regression analysis

I'm trying to find some data (two continuous variables that I believe are correlated) online for which I can perform a regression anaylsis, my assignment sheet says: The data may be found anywhere ...
2
votes
1answer
1k views

Understanding a Density Plot

I am currently plotting density plots in R to view the distribution of my data. An example density plot is here I understand N is the number of values in the data set and bandwidth is the the ...
2
votes
2answers
188 views

weighted ratings

I have a form where users can rate presentations and they can say how knowledgeable they are on the subject. The range for both sets is 1-5. (1 being lousy and 5 being great) So for example, a user ...
2
votes
1answer
49 views

Obtaining quadratic equation using Least Squares Method

This question is most likely extremely trivial, but I'm having some difficulty obtaining the least squares equation from the following data points: {{1.08, 0}, {1.07, 0.0659232}, {0.97, 0.1695168}, {...
2
votes
1answer
43 views

Fitting a curve given points

My set-up is the following, I have two variables $N$ and $TTR$, and I have these points for each variable: $N$ = [35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50] $TTR$ = [0.818, 0....
2
votes
1answer
29 views

How to describe a statistical dataset more precisely?

I am a newbie in stat and I need to be able to do this for a GIS application: Say I have the following dataset of only two possible values $0$ and $1$: $0,0,0,1,1,1,0,1$ The mean would equal $\frac{...
2
votes
1answer
39 views

Mean of values ${1 \over m} {\sum_{i=1}^m {s_i \over t_i}}$ vs. Value of sums ${\sum_{i=1}^m {s_i} \over \sum_{i=1}^m {t_i}}$, What is the relation?

Similar to: Average of products VS. product of averages I have $$ R = \{(s_1, t_1), (s_2, t_2), ..., (s_n, t_n)\} $$ With the property that, for all pairs $(s_i, t_i)$, $0 \le s_i < t_i$. $$ \...