Message 336505 - Python tracker

Message336505

Author	methane
Recipients	methane
Date	2019-02-25.09:38:53
SpamBayes Score	-1.0
Marked as misclassified	Yes
Message-id	<1551087533.63.0.252770144463.issue36103@roundup.psfhosted.org>
In-reply-to

Content
shutil.COPY_BUFSIZE is 16KiB on non-Windows platform. But it seems bit small for performance. As this article[1], 128KiB is the best performance on common system. [1]: https://eklitzke.org/efficient-file-copying-on-linux Another resource: EBS document [2] uses 128KiB I/O for throughput. [2]: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSOptimized.html Can we increase shutil.COPY_BUFSIZE to 128KiB by default? Note that 128KiB is small enough when comparing with Windows (1MB by default).

Content

shutil.COPY_BUFSIZE is 16KiB on non-Windows platform.
But it seems bit small for performance.

As this article[1], 128KiB is the best performance on common system.
[1]: https://eklitzke.org/efficient-file-copying-on-linux

Another resource: EBS document [2] uses 128KiB I/O for throughput.
[2]: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSOptimized.html

Can we increase shutil.COPY_BUFSIZE to 128KiB by default?

Note that 128KiB is small enough when comparing with Windows (1MB by default).

History
Date	User	Action	Args
2019-02-25 09:38:53	methane	set	recipients: + methane
2019-02-25 09:38:53	methane	set	messageid: <1551087533.63.0.252770144463.issue36103@roundup.psfhosted.org>
2019-02-25 09:38:53	methane	link	issue36103 messages
2019-02-25 09:38:53	methane	create