Home Original page

[Python-ideas] Asynchronous IO ideas for Python

Trent Nelson trent at snakebite.org
Wed Nov 26 21:56:07 CET 2014 
Relevant part of the video with the normal Python stats on the left and PyParallel on the right:

https://www.youtube.com/watch?v=4L4Ww3ROuro#t=838

Transcribed stats:

Regular Python HTTP server:

Thread Stats	Avg	Stdev	Max
 Latency	4.93ms	714us	10ms
 Req/Seq	552	154	1.1k
10,480 requests in 10s, 69MB
1048 reqs/sec, 6.9MB/s	

PyParallel (4 core Windows VM):

Thread Stats	Avg	Stdev	Max
 Latency	2.41ms	531us	10ms
 Req/Seq	1.74k	183	2.33k
32,831 requests in 10s, 216MB
3263 reqs/sec, 21MB/s

So basically a bit less than linear scaling with more cores, which isn't too bad for a full debug build running on a VM.

-----Original Message-----
From: Trent Nelson 
Sent: Wednesday, November 26, 2014 3:36 PM
To: 'Paul Colomiets'; python-ideas
Subject: RE: [Python-ideas] Asynchronous IO ideas for Python

Have you seen this?:

	https://speakerdeck.com/trent/pyparallel-how-we-removed-the-gil-and-exploited-all-cores

I spend the first 80-ish slides on async I/O.

(That was a year ago.  I've done 2-3 sprints on it since then and have gotten it to a point where I can back up the claims with hard numbers on load testing benchmarks, demonstrated in the most recent video: https://www.youtube.com/watch?v=4L4Ww3ROuro.)


	Trent.

-----Original Message-----
From: Python-ideas [mailto:python-ideas-bounces+trent=snakebite.org at python.org] On Behalf Of Paul Colomiets
Sent: Wednesday, November 26, 2014 12:35 PM
To: python-ideas
Subject: [Python-ideas] Asynchronous IO ideas for Python

Hi,

I've written an article about how I perceive the future of asynchronous I/O in Python. It's not something that should directly be incorporated into python now, but I believe it's useful for python-ideas list.

https://medium.com/@paulcolomiets/the-future-of-asynchronous-io-in-python-ce200536d847

And a place for comments at Hacker News:

https://news.ycombinator.com/item?id=8662782

I hope being helpful with this writeup :)

--
Paul
_______________________________________________
Python-ideas mailing list
Python-ideas at python.org
https://mail.python.org/mailman/listinfo/python-ideas
Code of Conduct: http://python.org/psf/codeofconduct/
More information about the Python-ideas mailing list