The Float format only supports single precision. It will only be accurate to 7 digits. Beyond 7 digits, round-off errors are likely.
The Double format supports double precision which is accurate up to 16 digits.
The Integer format supports numbers within the range of -2147483647 to 2147483647. Numbers outside this range will not be displayed correctly.
- To display these numbers as integers, enter the values in a Double format, change the Format to Fixed, and set the Decimals to 0.
There is a 50 character limit for the length of text strings in the data window.
Posted in: Data Windows