Jump to content

Floating Point/Rounding

From Wikibooks, open books for an open world

Rounding

[edit | edit source]

IEEE 754 specified four distinct rounding modes. We will talk about those modes, and their effects in this chapter. Also, rounding can play an important role in the accuracy of a floating-point computation, so we will discuss those effects here as well.

Rounding Modes

[edit | edit source]

Rounding Errors

[edit | edit source]

Relative Error

[edit | edit source]

Relative error is one measure of error commonly used with floating point numbers. If is an approximation to , then the relative error, , is defined as