SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
Technology Stocks : Intel Corporation (INTC)
INTC 47.14-6.1%Feb 10 3:59 PM EST

 Public ReplyPrvt ReplyMark as Last ReadFilePrevious 10Next 10PreviousNext  
To: Scott D. who wrote (4940)11/7/1996 7:55:00 PM
From: ted burton   of 186894
 
I think someone just got confused about what floating point is and how it works. In standard double precision floating point format, you can't express the number 12345678987654321 precisely, so it gets rounded off to 12345678987654300. It has nothing to do with the multiplication or with pentium - its just how floating point works. You'll get the same number if you go into excell on either a pentium or 486, and simply type 12345678987654321 into a cell. When you hit return it will round it off. Just for kicks I tried it on an RS6K & got similar results (using wingZ instead of excel), although it rounded to 12345678987654000 for typed intput & 12345678987654320 for the multiplication - go figure.

Now watch IBM stock plummet on news of the "math error". :)

Please note all comments express my views, not my employer's.
Report TOU ViolationShare This Post
 Public ReplyPrvt ReplyMark as Last ReadFilePrevious 10Next 10PreviousNext