Limit of the data value's exponent

ParaView Support
1

Hello,

I have a question about any limit of the exponent value in .vtk data. I have tried to open the attached .vtu files, but the first one ‘test.vtu’ triggers an error “cannot read point data array ~. The data array in the element may be too short.” Then, after I modified the exponent of a very small data value from -46 to -44, it is working properly. I am wondering if there’s any limit value for the exponent.

Thank you.

test.vtu (4.0 KB)
test_rev.vtu (4.0 KB)

Bild1
Bild11212×738 272 KB

2

I am wondering if there’s any limit value for the exponent.

Yes, read this: https://stackoverflow.com/questions/7644699/how-are-floating-point-numbers-stored-in-memory

The solution is simple. you are using float (aka float32) data representation, use double (float64) instead.

1 Like