[ale] Bash/Python Question

Brian Pitts brian at polibyte.com
Tue Mar 16 22:37:56 EDT 2010


On 03/16/2010 02:47 AM, Omar Chanouha wrote:
> Does anyone have a better solution than executing the parser at a
> constant time after the downloader?
> 
> The gatherer looks something like:
> 
> for file in list:
>  download.py file
> 
> I need the gatherer to work this way because I want the files to
> download in parallel in order to speed up the process.

As others have said, use threading and queues. I think you will find
this example very relevant.

http://www.ibm.com/developerworks/aix/library/au-threadingpython/

-- 
All the best,
Brian Pitts


More information about the Ale mailing list