Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I'm dealing with sets of data that have distributions somewhat like this:

                   X X
       X          X   X
                  X   X
                 X     X
                 X     X
         X      X       X
     X         X         X
             X             X
   X       X                 X
 X                                X
X                                      X  X  X

i.e, an approximate normal distribution, with a large amount of noise in the lower values.

I want to programatically "filter out" the noise. As in, I'd like work out a value between the noise values and the rest of the data and remove values below that.

The noise doesn't tend to follow any distribution, and occasionally the frequency of noise values outweighs the frequency of desired values.

How best can I go about doing this?

share|improve this question

1 Answer 1

A number of options:

  • Fit only the higher frequencies.
  • Fit the data to multiple Gaussians - and retain only the main peak.
  • Redo the experiment multiple times to reduce the noise.
share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.