Precision of variables in fx
Posted: 2017-12-31T17:28:19-07:00
Using a variable within an fx expression kills precision. For example:
Tested with v6.9.5-3 Q16 on Windows 8.1.
Code: Select all
f:\prose\PICTURES>%IM%identify -precision 16 -format "%[fx:1/49]" xc:
0.02040816326530612
f:\prose\PICTURES>%IM%identify -precision 16 -format "%[fx:V=1/49;V]" xc:
0.0204082