0
votes
1answer
32 views

Smoothing Spline Example

I am learning the smoothing spline method. I saw that smoothing spline is a penalty term to reduce overfitting in linear regression. Given dataset {$(x_1,y_1),(x_2,y_2)..(x_n,y_n)$}So the formular ...
1
vote
1answer
42 views

Data compression from lack of patterns

From my understanding, lossless data compression takes advantages of statistical patterns. I want to know if it is possible to compress data based on the lack of patterns, such as a random string of ...
0
votes
0answers
30 views

Simple maths for an algorithm to searching a table to find out if one type of entry has a causal effect upon another type?

I asked this over on StackExchange and was sent over here... I have a database table which is recording two different types of events which seem to be related to one another. It records the date and ...
1
vote
2answers
42 views

Best way to generalize a distribution of data into smaller subsets?

Suppose I had a data set as follows: 168.95, 176.83, 178.13, 179.61, 179.44, 172.83, 173.37, 174.06, 174.94, 175.43, 175.73, 175.5, 173.78, 174.06, 172.71, 174.3, 178.38, 178.43, 177.18, 175.34, ...
1
vote
1answer
21 views

Rating based on 2 criterias

I'm trying to write rating system which scores items based on two criteria with different importance. Criteria_1 will have importance 0.2 and Criteria_2 will have 0.8. Maybe a bit of trickiness adds ...
0
votes
0answers
14 views

In classification algorithms what is the idea behing choosing the first n values?

I came across the cluster pruning algorithm the other day. The algorithm first chooses √N random leaders for N points and after that assigns the new points to the nearest leaders. What is the idea ...
1
vote
1answer
56 views

Given two arrays, how can one determine the the intersection?

I have two datasets (A & B). They each have 1000 numbers. 99% of the time: A < x <= B However, 1% of the time B < x < A. How can I solve for x, ...
0
votes
0answers
41 views

How to search for an object in more efficient way?

I have a doubt how to check if structure contains an object. Simple sketch of my structure: Root - is a group which can contain groups, keys, values. Group - can contain groups keys, values. Key - ...
1
vote
1answer
34 views

How can I mathematically determine the next available index for a child row in this data set?

I have a data set that looks like this: $$ \begin{array}{c|lcr} & 0 & 1 & 2&3&4&5&6&7&8&9 \\ \hline parent & x & x & x & x & ...
1
vote
1answer
171 views

Mathematical calculation to regenerate numeric series

I am searching for a mathematical technique by which I can perform the following, Let me explain first what i want to do. consider a numeric series: ...
1
vote
1answer
203 views

Html Tag counting - Rate of Change formula

I've been trying to a find a statistics-esque formula for calculating the rate of change for html tags which are either added or removed from various websites. So, for example, with the scraper I'm ...
2
votes
2answers
143 views

Working out the “best” score based on quantity and ratio

I'm not an expert with mathematics so I hope I'm posting in the right place! I've got a lot of products which can be rated good, bad and OK by a user. What I'm having trouble with is finding which is ...
2
votes
2answers
148 views

weighted ratings

I have a form where users can rate presentations and they can say how knowledgeable they are on the subject. The range for both sets is 1-5. (1 being lousy and 5 being great) So for example, a user ...