Home Original page

[Python-Dev] Unpickling memory usage problem, and a proposed solution

Antoine Pitrou solipsis at pitrou.net
Fri Apr 23 23:24:10 CEST 2010 
Collin Winter <collinwinter <at> google.com> writes:
> 
> I don't think it's possible in general to remove any PUTs if the
> pickle is being written to a file-like object.

Does cPickle bytecode have some kind of NOP instruction?
You could keep track of which PUTs weren't necessary and zero them out at the
end. It would be much cheaper than writing a whole other "optimized" stream.

(of course it only works on a seekable stream :-))

Regards

Antoine.
More information about the Python-Dev mailing list