What is IM's strategy for rounding floats?

Questions and postings pertaining to the development of ImageMagick, feature enhancements, and ImageMagick internals. ImageMagick source code and algorithms are discussed here. Usage questions which are too arcane for the normal user list should also be posted here.
Post Reply
donahchoo
Posts: 8
Joined: 2018-07-20T13:38:38-07:00
Authentication code: 1152

What is IM's strategy for rounding floats?

Post by donahchoo »

Hi,

I'm trying to understand how IM will round floats when resizing. I've seen a case where I had a resize operation result in an image with a 337.5 height and that got rounded down to 337. I'm not seeing a case where an where a resize results in 119.9877 and that is getting rounded up to 120. I thought IM was basically truncating the floats, but that's not the case.

Any suggestions?

Thanks!
snibgo
Posts: 12159
Joined: 2010-01-23T23:01:33-07:00
Authentication code: 1151
Location: England, UK

Re: What is IM's strategy for rounding floats?

Post by snibgo »

I would expect that most operations that convert from float to integer will round, rather than truncate. For example:

Code: Select all

f:\web\im>%IMG7%magick -size 1199877x1 xc: -resize 0.01% info:

xc: XC 120x1 120x1+0+0 16-bit sRGB 0.203u 0:00.202
snibgo's IM pages: im.snibgo.com
donahchoo
Posts: 8
Joined: 2018-07-20T13:38:38-07:00
Authentication code: 1152

Re: What is IM's strategy for rounding floats?

Post by donahchoo »

Yeah, I was expecting it to just use C's round function. I'll test some more...
User avatar
fmw42
Posts: 25562
Joined: 2007-07-02T17:14:51-07:00
Authentication code: 1152
Location: Sunnyvale, California, USA

Re: What is IM's strategy for rounding floats?

Post by fmw42 »

I am answering a different aspect of resizing. I am not sure how it determines the final image size.

But, when resizing it does resampling to get the fractional input position and blends neighboring pixels to get the resampled (interpolated) pixel color for putting in the output at a given integer pixel. See

http://www.imagemagick.org/Usage/filter/
http://www.imagemagick.org/Usage/distorts/#summary
donahchoo
Posts: 8
Joined: 2018-07-20T13:38:38-07:00
Authentication code: 1152

Re: What is IM's strategy for rounding floats?

Post by donahchoo »

Thanks, I'll study and learn.
Post Reply