textdeskew regression_Arr: bad array subscript

[wrumble]

I get the following error when using the textdeskew script:

Code: Select all

awk: line 38: syntax error at or near *
/home/work/textdeskew: line 468: regression_Arr: bad array subscript
/home/work/textdeskew: line 474: regression_Arr: bad array subscript

I havent done anything to change it but i am using it on a docker image where i call it from a ruby app.

[fmw42]

Please post your input image to some place such as dropbox.com that won't change the format and provide your exact command line. That way I can test and debug.

Have you tried just processing it in a terminal to be sure it is not your ruby or docker that is the problem. You may also need to set Environment variables differently in your environment as opposed to bash shell. Read my pointers on my home page to be sure you have set up the script and your environment properly.

It is also possible that your image does not conform to the assumptions of the script or needs argument adjustments. But that is why I need to have your image and script arguments (as values not variables).

If the image is proprietary or in any case, you may contact me offline at my email address on my home page.

Also what is your IM versions and platform/OS.

Please read viewtopic.php?f=1&t=9620

[wrumble]

Hi, i have uploaded the image not sure if it gets processed or not though? I run the script on default without any variables like so

Code: Select all

`textdeskew #{imageFile.path} #{imageFile.path}`

I have your textcleaner script in the same docker image/ruby app and that runs fine. My terminal version of imagemagick gives me

Code: Select all

Version: ImageMagick 6.8.9-9 Q16 x86_64 2017-07-31 http://www.imagemagick.org
Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
Features: DPC Modules OpenMP
Delegates: bzlib cairo djvu fftw fontconfig freetype jbig jng jpeg lcms lqr ltdl lzma openexr pangocairo png rsvg tiff wmf x xml zlib

Oh and im runnning macOS Sierra 10.12.6 (16G29)

The docker image is https://github.com/wrumble/tesseractServer

Have just run locally and get the following:

Code: Select all

convert: delegate library support not built-in `./MAXIMA.43226/tmpI.mpc' (FFTW) @ warning/fourier.c/ForwardFourierTransformImage/981.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
identify: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: unable to open image `./MAXIMA.43226/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/2701.
convert: no images defined `./MAXIMA.43226/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3258.
awk: division by zero
 input record number 20, file
 source line number 11
/usr/local/bin/textdeskew: line 468: regression_Arr: bad array subscript
/usr/local/bin/textdeskew: line 474: regression_Arr: bad array subscript
Rotating Image 90 degrees

Thanks for replying

[fmw42]

textdeskew gives me no errors on my Mac OSX Sierra. But it rotates an extra 90 degrees as I mentioned in the script might occur.

It does require that you have the FFTW delegate library installed. The error seems to imply a problem with FFTW

I see I have a typo from a previous script for the tmp file name. I will fix that. But it has no bearing on the script.

textdeskew JKxDCP3.png tmp.png
Rotating Image 89.7679 degrees

In this case the FFT does not show a regular array of spots to use to get the text alignment. Probably because the spacing is too close relative to the size of the font. Also the background is gray and not white. So there is not much contrast to help determine what is space and what is text. I tried converting the gray background to white, but it still did not help.

To be sure you have your script configured properly, test using one of the images from my example page first.

There is also a switch for syntax from different versions of ImageMagick. What is your IM version?

[wrumble]

ok right i will always be using this script on receipt images is there a better way to setup the textcleaner and textdeskew for this? my version is

Code: Select all

Version: ImageMagick 6.8.9-9 Q16 x86_64 2017-07-31 http://www.imagemagick.org
Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
Features: DPC Modules OpenMP
Delegates: bzlib cairo djvu fftw fontconfig freetype jbig jng jpeg lcms lqr ltdl lzma openexr pangocairo png rsvg tiff wmf x xml zlib

[fmw42]

I do not think either will help in this image case. I would run textcleaner first and then textdeskew, in general. I tried textcleaner on your image and it did not work either. That is why I tried convert image -white-threshold 50% result and then processed the result with textdeskew. But upon checking with -fft, there were no obvious indications of a regular array of spots for the script to key on. That is why it fails.

If you have FFTW installed as it appears, then I am not sure why you get that message. It could be a bug in IM 6.8.9.9 which is about 110 versions old. So I would recommend that you upgrade ImageMagick and your delegates.

[wrumble]

I dont know why im getting an older version as with docker im running

Code: Select all

RUN apt-get update && apt-get install -y \
        build-essential \
        ruby-full \
        fftw-dev \
        libgs-dev \
        libffi-dev \
        libgmp3-dev \
        ruby-dev \
        imagemagick

I wonder if its just a bad image, although the textcleaner script worked on it for me. just not the textdeskew. If im running `textcleaner -u -T image.jpg` do you think there is any need for the textdeskew script?

[fmw42]

Well that may just be the latest version they have with apt-get. If on your own Mac Sierra you could install from the IM binary. See http://www.imagemagick.org/script/download.php#macosx or from MacPorts or Homebrew.

Does the Docker version of ImageMagick include FFTW delegate?

I am confused. What is the version of IM on docker and what is it on your desktop terminal?

With textcleaner the -u option uses the IM -deskew. That works differently from my textdeskew. But it will not rotate more than about 5 degrees. So if you need more rotation, then either use my script unrotate or textdeskew where appropriate.

[wrumble]

Right, im currently struggling to get this install from source working on docker but will keep trying. The IM versions i have shown you have always been from the docker image as thats where ill be using it.

[fmw42]

Sorry, I do not understand. On which system does it not work and what is the IM version?

[wrumble]

On my docker image the version is

Code: Select all

Version: ImageMagick 6.8.9-9 Q16 x86_64 2017-07-31 http://www.imagemagick.org
Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
Features: DPC Modules OpenMP
Delegates: bzlib cairo djvu fftw fontconfig freetype jbig jng jpeg lcms lqr ltdl lzma openexr pangocairo png rsvg tiff wmf x xml zlib

This is where im getting the error

Code: Select all

awk: line 38: syntax error at or near *
/home/work/textdeskew: line 468: regression_Arr: bad array subscript
/home/work/textdeskew: line 474: regression_Arr: bad array subscript

But when running on my mac i got the same error but it was more verbose and hinted at the lack of fftw

[fmw42]

On your Mac, run

convert -version

and tell me what you get.

[fmw42]

I get a proper completion of the textdeskew on IM 6.8.9.9 on my Mac OSX Sierra. That is no errors, but it does not rotate the image properly. Perhaps your delegates need upgrading?

[wrumble]

I just ran `brew install imagemagick --with-fftw` on my mac to update and i get

Code: Select all

Version: ImageMagick 7.0.7-8 Q16 x86_64 2017-10-22 http://www.imagemagick.org
Copyright: © 1999-2017 ImageMagick Studio LLC
License: http://www.imagemagick.org/script/license.php
Features: Cipher DPC HDRI
Delegates (built-in): bzlib freetype jng jpeg lzma png tiff xml zlib

when i run `textdeskew rotate.png rotate.png` i get

Code: Select all

convert: delegate library support not built-in `./MAXIMA.608/tmpI.mpc' (FFTW) @ warning/fourier.c/ForwardFourierTransformImage/898.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
identify: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: unable to open image './MAXIMA.608/tmpS.mpc': No such file or directory @ error/blob.c/OpenBlob/3143.
convert: no images defined `./MAXIMA.608/tmpS.mpc' @ error/convert.c/ConvertImageCommand/3275.
awk: division by zero
 input record number 20, file
 source line number 11
/usr/local/bin/textdeskew: line 468: regression_Arr: bad array subscript
/usr/local/bin/textdeskew: line 474: regression_Arr: bad array subscript
Rotating Image 90 degrees

But i can see there is no fftw in the delegates.

How can i add fftw to the delegates and update them?

[fmw42]

I don't use Homebrew, so cannot say how to make it work. But it is clear you do not have FFTW nor many other delegates that you might as per your other system. You are also installing IM 7 rather than IM 6, though in principal that should not be a problem if it gets installed with a symbolic link from convert to magick.

On your Docker system, what do you get from

Code: Select all

convert -version

In my textdeskew script, change line 132 to

Code: Select all

debug="true"		# show debug information

Run the script and provide me with the results that are returned for the debugging information.