Home Original page

[Python-ideas] Enabling access to the AST for Python code

Terry Reedy tjreedy at udel.edu
Fri Jul 3 21:33:46 CEST 2015 
As I remember, the proposal is or would have to be to give code objects 
a new attribute -- co_ast.  This would require an addition to marshal to 
compress and uncompress asts.  It would expand both on-disk .pyc files 
and even more, in-memory code objects.

On 7/2/2015 4:25 PM, Neil Girdhar wrote:
> Why would it require "a lot of extra memory"?
 > A program text size is measured in megabytes,
 > and the AST is typically more compact than the code as text.

Why do you think that?  Each text token becomes an node object that is a 
minimun 56 bytes (on my 64-bit Win7 3.5). For instance, a one-byte '+' 
(in all-ascii code) balloons to at least 56 bytes in the ast and 
compiled back down to 1 byte in the byte code.  I expect the 
uncompressed in-memory size of asts to be several times the current size 
of corresponding code objects.

-- 
Terry Jan Reedy
More information about the Python-ideas mailing list