Home Original page

Too many open files

Christian Heimes lists at cheimes.de
Mon Feb 4 09:50:15 EST 2008 
Jeff wrote:
> Why don't you start around 50 threads at a time to do the file
> writes?  Threads are effective for IO.  You open the source file,
> start a queue, and start sending data sets to be written to the
> queue.  Your source file processing can go on while the writes are
> done in other threads.

I'm sorry, but you are totally wrong. Threads are a very bad idea for IO
bound operation. Asynchronous event IO is the best answer for any IO
bound problem. That is select, poll, epoll, kqueue or IOCP.

Christian
More information about the Python-list mailing list