I’m looking to learn about this language from a technical level, and any searches I do on today’s search engines is just going to return guides to writing Python code, which is not what I want.
I understand how C++ works. For example, I know that virtual functions are stored as a trap table in an object’s instance, and the function is wrapped around something that decodes that trap table from this
object instance.
I’m wondering if there’s something that goes into that level of technicality with python. For example, I would want to know how function declarations (and re-declarations) work in python. Is the bytecode stored as a heap object which can be freed just as a regular heap object? Is it a map of strings within the current stack context? How does creating a thread handle it?
Some of those details are portable, particularly the behavior of code objects. Function declarations (
def
statements) bind code objects to names within a namespace; binding within aclass
namespace will create methods by calling the declared metaclass, which defaults to thetype()
builtin type object.Some other details are not portable. CPython stores code objects on the C heap and allocates generic closures; it supports either a
dict
from strings to locals, or user-declared slots naming a tuple of locals. PyPy automatically computes slots in all cases and supports thedict
as a special case. Threads generally share a single heap per interpreter, so the creation of threads doesn’t matter for declaring or instantiating objects; note that the community makes this work by pushing the convention that.__init__()
methods should not do computation and instead should merely initialize the locals, akin to similar conventions in C++. That said, Jython threads are Java threads, not OS threads like in CPython or PyPy, so normal assumptions about threading may not hold.You will have to let go of some of your practices around memory management. Python is memory-safe and garbage-collected by default; while sometimes you’ll want to remove names or map keys with
del
, it usually isn’t necessary. Similarly, while there are maybe a half-dozen ways to customize class creation and memory layout, it’s almost never actually necessary to use more than one of them at a time. Instead, stick to writing Pythonic code, and let runtimes like PyPy worry about performance. PyPy goes fast by simplifying what happens under the hood; if it exposed guaranteed internal structure then it would be slower.