Questions on the use of mathematical techniques to extract properties from given data. Consider if your question might be more suited for Cross Validated (stats.SE) instead.

learn more… | top users | synonyms

1
vote
0answers
20 views

Find two clusters in an ordinated array

As the titles goes, I have an array of sorted real positive numbers, and some information on the structure of the data. I know that there are two constants $a>>b>0$ and two other numbers ...
0
votes
1answer
36 views

Chart Question and Percentages

The Venn Diagram above represents the 20 students who took one or more of the 3 available art class or took no art class at all. What percent of the students took only 1 art class? A. 10% B. 20% C. ...
1
vote
2answers
79 views

How to interpret the result of correlation between two discrete signals

Before starting, let me say I'm not a mathematician, I'm just a curious engineer, with a master's degree in engineering and computer science. I have been using this book The Scientist and Engineer's ...
1
vote
1answer
361 views

Least squares fitting using cosine function?

Hello I am trying to fit a harmonic of the form $$y = b + c\cos(x)$$ to four data points (0,6.1) (.5,5.4) (1,3.9) (1.5,1.6) using least squares for homework. I know that the error $= Y_i - f(x_i)$ but ...
1
vote
1answer
53 views

What statistical analysis to use on a list of dates?

I suffer from migraines and for many years I've kept a log of each attack. I now want to do some analysis on the dates of each attack to see if there are any patterns. I intend to check the ...
1
vote
1answer
77 views

Queue and Stack in Computer Science and relation to MATH

For Creating a Queue Q we use two Stack S1,S2. for insert x in the end of Q we do Push(S1,x). for deleting element from front of Q, (if Q is not empty) we do Pop(S2). if on Q that at first is empty, ...
0
votes
0answers
104 views

Using significant figures, what would the answer be?

I've been learning about significant figures and I have a few questions. When you multiply/divide, the number of significant figures in the answer should be the same as the term with the least number ...
0
votes
1answer
61 views

How to find a graph's equation from its points

I have a set of data that constitutes the graph on the picture. What I want to know is how would I find the equation equivalent to that kind of graph? The X are on the interval $[1,10]$.
1
vote
1answer
60 views

Similarity measurement for strings of letters

Let's say, I have 10 different groups, and each group has its own string sequence. So, it should be like : G1 -> CHFAIEBD G2 -> HCFJIGBD G3 -> HCFAIJBD G4 -> HFCIJEBD G5 -> ..... G6 -> .... The ...
0
votes
1answer
42 views

Feature selection of Gabor filter

I am working with Gabor filter with level set method here. As you known, gabor filter gave many filter output. Some of them is not necessary. Could you suggest to me some method that can choose best ...
0
votes
3answers
95 views

fit sine wave to data

I have some astronomical data that I want to fit a sine wave to. I want to fit something of the form y = Asin(Ωt+Φ). I know the period of the sinusoid is equal to ...
1
vote
3answers
1k views

fit sine wave to data

I have some astronomical data which I know has a sinusoidal component to it of the form y = Asin(Ωt+Φ). The period of the sinusoid is equal to a sidereal day. So ...
1
vote
1answer
34 views

Find median given large amount of data

Listing all the possibilities would take time. Would there be a faster and more efficent way to find the median?
0
votes
1answer
63 views

How do you call it when you remove the top n% and the bottom n% of a dataset?

I am currently writing about a dataset of collected handwritings. I want to show some characteristics of the dataset. For example I think it is interesting to show how long it took users to create the ...
0
votes
2answers
113 views

Creating a polynomial function with no x-intercept

I have an understanding of polynomials and how to create a function based on the leading coefficient, degrees, x-intercepts, etc. My question is how do i go about creating a polynomial function that ...
1
vote
0answers
50 views

$y=\sqrt x \rightarrow \ln y = \ln x$ problem

So I had some raw data, and it looked like there was a square root relation. I plotted graphs of $y=\sqrt{x}$ They look kind of straight. So doing the algebra and taking the ln of both sides, we ...
2
votes
3answers
124 views

Finding similarity between elements using statistics

I have a dataset of DJs in which I'm trying to find DJs similar to a specific DJ. Each DJ has a set of a genres with a certain percentage. How can I find the similarity between 2 DJs? The following is ...
0
votes
1answer
731 views

Median value resulting in negative number

I know the that the formula for finding the median of grouped data that is: $$\mathrm{Median} = L_m + \left [ \frac { \frac{n}{2} - F_{m-1} }{f_m} \right ] \times c$$ And I also know what the ...
0
votes
1answer
75 views

Data interpretation problem

Approximately what is the minimum amount of caffeine, in milligrams, consumed per day by a person who daily drinks two 10-ounce mugs of percolated coffee and one 12-ounce cup of a caffeinated ...
1
vote
1answer
37 views

Multidimensional fitting of two data sets

My problem is the following: A laser gives out a bunch of data points which are reflected off a metal surface and recorded by a camera attached to the side of the laser. The image the camera receives ...
0
votes
1answer
71 views

Finding a population Function

I have been given the population of the USA from 1790 - 1980 (increasing in intervals of $10$) and I am asked to solve this differential equation. Using $t$ as time in years, and $P$ as size of ...
0
votes
1answer
52 views

Formula to link two exponential values together - doesn't quite work

Basically, I've done a script, and I'm stuck on a formula for it. After I run the code on a cube, based on two different inputs (detail level and vertex average iterations), the resulting size will be ...
0
votes
1answer
33 views

Work out if the relationship between 2 datasets is constant

I have 2 one-dimensional datasets, let's call them a and b. I want to know the correlation between ...
0
votes
0answers
331 views

How do you use R to find the box counting dimension of a two dimensional set of data, or scatter plot?

I'm using the software R to do some analysis on some data sets for a graduate project. R has a package called "fractaldim", in this package is a function for finding the box counting dimension. The ...
0
votes
1answer
64 views

Is there a way to use the Generalized Mean to find the “best” possible mean to use for a specific data set?

I've recently learned about the Generalized Mean as an abstraction of the many different means, includeing the Geometric, Arithmetic, and Harmonic means, as well as others. It is my understanding ...
1
vote
1answer
35 views

Survival analysis in survey dropouts?

I am working with a survey data set and am curious about who abandoned it before finishing all the questions. I have information on how many questions each respondent answered (no skipping allowed) ...
1
vote
0answers
50 views

Form of a function I can fit like a polynomial that has an asymptote on x-axis and is always positive

So I have a small list of pairs of the form $(\mathbb{R}, \mathbb{R}_{\geq 0})$ and I want to fit a function to this data. Additionally I know that as $x$ grows large in either direction $y$ tends to ...
0
votes
1answer
135 views

What is purpose of correlation kernel? IIs it high pass filter or low pass filter?

I am research about correlation kernel and I have some questions that need your help. Let see the pp. 3302-3303 in the http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6517250&tag=1 The special ...
1
vote
0answers
41 views

Linear model for data that follow gaussian distribution

I have a question about linear regression. We have the linear regression of input data $(X,Y)=((x_1,y_1),(x_2,y_2)...(x_n,y_n))$ is $$F=aX+b$$ a,b are factors of the linear line, $y_i$ is {-1,1}. ...
0
votes
1answer
3k views

Finding the range from standard deviation and Gaussian Curve

The figure above shows a normal distribution with mean m and standard deviation d, including approximate percents of the distribution corresponding to the six regions shown. Suppose the heights of a ...
1
vote
1answer
30 views

How to determine who improved the most considering diminishing returns

My friends and I are competing in a fitness challenge against each other. We will determine the winner based on who has the greatest percentage improvement after three months. Here is the problem: if ...
0
votes
1answer
34 views

Method for detecting anomalies in timeseries?

I am exploring creating alerts for anomalies in a timeseries. Say that I have a graph like this: There are two anomalies here that I would wanted to be alerted on: First, on April 7th with there ...
0
votes
0answers
60 views

How to interpret the indicator function?

I am reviewing a paper titled " Bayesian Sampling Approach to Decision Fusion" by Biao Chen and Pramod K Varshney. This paper uses an indicator function that I am not being able understand. The ...
0
votes
0answers
192 views

Betfair Odds Percentage Movements & Hedging

I want to determine if the odds on Betfair have decreased by a certain percentage and then calculate the hedged profit when hedging on that percentage, but it's made tricky by the fact that decimal ...
2
votes
2answers
472 views

How to find a line that minimizes the average squared perpendicular distance from the given points to the line?

I have set of points scattered around the origin. How to find a vector, such that the average squared distance (perpendicular distance) from points to the vector is minimised? Added For example, ...
1
vote
0answers
241 views

Implementation of Total Variation Regularization Algorithm (Lagged Diffusivity Algorithm)

I am trying to compute the derivative of an experimentally-measured quantity as a function of time. The data are fairly noisy, which causes problems. For instance, using finite differences (central ...
3
votes
2answers
548 views

Difference between Topological Data Analysis and Graph Technology

I'm trying to understand the difference between Oracle's graph technology, which apparently has an inherent understanding of topology, and Ayasdi's Topological Data Analysis technology. Are these two ...
0
votes
0answers
121 views

On the truncation of spherical harmonics

Suppose there is a function $f(\theta,\phi)$ defined on the surface of a sphere, and $\theta$ and $\phi$ are the polar and azimuthal angles respectively. Similar with the fact that a function defined ...
2
votes
1answer
105 views

Is topological data analysis useful for low dimensional data?

I often read how Topological Data Analysis (TDA) is useful especially for highly dimensional data. But, what about (apparently) low dimensional ones? Example: consider measuring the resistance of a ...
0
votes
1answer
53 views

Calculating Inflection Point in Real World Data

I can think of a few ways to get a good grasp of this problem from an experimental perspective, but I'm looking for a more general explanation that can be applied to different situations. If this ...
2
votes
1answer
54 views

Data Analysis and Probability

Two dice with a difference ... They appear identical, but one die is fair and the other is loaded so that the probability of throwing a 6 is 0.25. Bev picks a die at random and throws it, and it shows ...
1
vote
1answer
39 views

How to work out the formula that connects several numbers

I have an interesting problem. Say I have lots of datasets like this: a = 21 b = 23 c = 58 d = 498 etc (lots of other values) X = 85 I need to find the formula ...
7
votes
2answers
2k views

Where to start learning about topological data analysis

I was wondering if anyone could help me out with finding a nice introductory introductory text for topological data analysis (I'm speaking as somebody who has two semesters of experience with ...
1
vote
1answer
372 views

Extremely poor polyfit, what am I doing wrong?

I have a dataset with me: http://pastebin.com/YZArky1j, which I am trying to polyfit. This is what I used to perform the polyfit: ...
0
votes
1answer
86 views

Smoothing Spline Example

I am learning the smoothing spline method. I saw that smoothing spline is a penalty term to reduce overfitting in linear regression. Given dataset {$(x_1,y_1),(x_2,y_2)..(x_n,y_n)$}So the formular ...
0
votes
2answers
947 views

Probability of name collision

Question on statistics & probability: I am trying to find the best way to build a unique key. Data i have: 1) first name 2) last name 3) DOB 4) gender So, assuming those are correct fields (not ...
1
vote
0answers
32 views

Effect of Event on Another

I am having difficulty wrapping my mind around conceptualizing the impact of one event on another. For the scope of this question, let's define the following: Event A: An assault occurs; Event B: A ...
1
vote
0answers
41 views

Bivariate Correlation Unique solution

I have a set of data, let's say "score vs loss ratio", the score is an arbitrary number I gave to a team by looking at their past history. I want to prove my hypothesis which is higher the score, high ...
0
votes
1answer
103 views

Variance of Estimated Coefficients in Logistic Regression

I have a logistic regression model with a binary variable as the response and a categorical variable with 3 categories as a predictor. The fitted model is: logit(P(Y=1)) = intercept -0.19*C2 + ...
1
vote
1answer
83 views

Empirical Copula

I am trying to find the empirical copula linking two random variables $X$ and $Y$. I have some data available but it's limited with respect to the variable $Y$ and I am not convinced it's enough data ...