Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have a test which benchmarks the performance of my 3D rendering software, in frames per second. I run the test for each revision of my rendering software to check that I'm improving performance. For any given revision, each test run gives a slightly different result, so I actually run the test a number of times and track the mean and variance for each revision.

Each test run takes a reasonable duration of time, so I would like to find the minimum number of iterations that will give me confidence in the mean value that I measure. Any suggestions on how to frame this problem statistically would be much appreciated.

share|cite|improve this question
    
See here for one method to determine the number of iterations. – Daryl Nov 5 '12 at 11:01

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.