Floating Point representation limited to 7 characters

Affected products:

ESP-HMI1-P Version 1.3

Implications of the problem:

Rounding errors occur in the last decimal places (> 7) of a displayed variable.

When does the problem occur:

The problem occurs in digit fields with a floating point display format and more than 7 visible digits.

The following illustrates a problem with 10 visible digits:
  • Variable content:  1.000000000 (correct value)
  • Display on the terminal: 1.000000040 (actual value)

The following illustrates that no problem occurs with 7 visible digits:
  • Variable content:  1.234567 (correct value)
  • Display on the terminal: 1.234567 (actual value)
  • also OK:   12.34567; 1234.567, 123456.7 or 0.1234567

Diagnostic options:

Compare the variable content on the transmitter side with the display on the terminal.

Short-term measures/recommendations:

Do not use more than 7 characters in the floating point display format.

Function restriction is removed with SW-V1.4, see 20021927.

URL for linking this AKB article: https://www.lenze.com/en-de/go/akb/20020749/1/
Contact form