Significant Digits [message #189696] |
Fri, 25 August 2006 12:19 |
whatfur
Messages: 29 Registered: July 2006
|
Junior Member |
|
|
Running ProC on AIX and have a oracle table
value stored as NUMBER and enter a value equivalent
to 2^32 (i.e. 4494267295) and when I select it into
a C variable defined as a float its precision
gives me a changed value (i.e. 4494267392)
Note change in blue. I need the value exactly as it is
entered. (trying to cast to longs fails as I think longs
on my system do not hold that large a number).
Any help appreciated.
|
|
|
Re: Significant Digits [message #189715 is a reply to message #189696] |
Fri, 25 August 2006 16:42 |
whatfur
Messages: 29 Registered: July 2006
|
Junior Member |
|
|
Oops never mind...I made the wrong assumption
that floats had all the significance I needed.
Switched everything to doubles and I can
get what I want.
Rock on.
|
|
|