0 Members and 1 Guest are viewing this topic.

That's some kind of maths joke, right?

Rounding ErrorSqueezing infinitely many real numbers into a finite number of bits requires an approximate representation. Although there are infinitely many integers, in most programs the result of integer computations can be stored in 32 bits. In contrast, given any fixed number of bits, most calculations with real numbers will produce quantities that cannot be exactly represented using that many bits. Therefore the result of a floating-point calculation must often be rounded in order to fit back into its finite representation. This rounding error is the characteristic feature of floating-point computation. The section Relative Error and Ulps describes how it is measured.Since most floating-point calculations have rounding error anyway, does it matter if the basic arithmetic operations introduce a little bit more rounding error than necessary? That question is a main theme throughout this section. The section Guard Digits discusses guard digits, a means of reducing the error when subtracting two nearby numbers. Guard digits were considered sufficiently important by IBM that in 1968 it added a guard digit to the double precision format in the System/360 architecture (single precision already had a guard digit), and retrofitted all existing machines in the field. Two examples are given to illustrate the utility of guard digits.

gleefully altering one’s beliefs to accommodate new information should be a badge of honor

I'd like to thank Stack Overflow for my job. Every day.

I have no idea what this is about. Probably happily so.

Quote from: Noisy Rhysling on February 12, 2019, 10:11:46 AMI have no idea what this is about. Probably happily so. StackOverflow is a Q&A site aimed at programming and scripting where every programmer goes when they need to actually do something more complicated than "Hello World".