Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

What exactly does it mean by "half a unit in the nth place"? I am reading numerical analysis and this term is popping out very frequent in the first chapter itself,my first encounter with this is while reading the rounding-off error rules.

From few solved examples I can understand (or probably guess) it mean $5$ but what I still don't understand why such a abstruse term ?

Thanks,

share|improve this question
add comment

1 Answer 1

up vote 5 down vote accepted

You need to think in terms of significant figures. The nth place is the nth significant figure. Consider, for example, the number 123.45 (base 10). A unit in the second place is 10, in the 3rd place is 1, in the 4th place is 0.1, etc. So half a unit in the second place is 5, in the 3rd place is 0.5, in the 4th place is 0.05, etc.

Now, in the context in which the book uses it I expect that n is the number of digits used to represent a number. So if all numbers are represented with 5 significant decimal digits, 123.45 really represents the range 123.445 to 123.455 (probably half-open). Then the maximum absolute error in that representation is half a unit in the nth place.

Does that make sense?

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.