[howto] running batch jobs in parallel on Windows
Posted: 2012-05-01T10:30:18-07:00
I have created a program that runs a command-line executable in parallel on a group of similar files and thought this would be useful to Windows ImageMagick users. I was able to run the convert.exe program to convert 1440 jpg files (avg size: 135kb) to tiff files. On a 16 CPU system this created 1440 tiff files in 74 seconds, which is just under 20 image conversions per second.
My program is called mp, short for multi-process. From a command line, you would use:
mp.exe convert “_input_ _base_.tiff” -- *.jpg
Anything inside of underscores are macros that get substituted with file names. See the website for more information.
The program figures out the number of CPUs your system has and runs that many subprocesses concurrently.
1) https://github.com/jftuga/Windows/tree/master/mp
2) click on the mp.exe link
3) click on Raw to download the actual mp.exe exectuable
4) you can also download the AutoIt source code by clicking on mp.au3
If you decide to try this out, please reply as I love to get some feedback.
Thanks,
-John
My program is called mp, short for multi-process. From a command line, you would use:
mp.exe convert “_input_ _base_.tiff” -- *.jpg
Anything inside of underscores are macros that get substituted with file names. See the website for more information.
The program figures out the number of CPUs your system has and runs that many subprocesses concurrently.
1) https://github.com/jftuga/Windows/tree/master/mp
2) click on the mp.exe link
3) click on Raw to download the actual mp.exe exectuable
4) you can also download the AutoIt source code by clicking on mp.au3
If you decide to try this out, please reply as I love to get some feedback.
Thanks,
-John