Python Internal Storage Models

This was a conversation I had with ChatGPT to deepen my knowledge of the memory models behind pandas, ibis (Arrow) and DuckDB in Python. As there is a lot of material available on the web on this topic, GenAI's results are quite relevant and reliable if you follow through on its responses. Deepening your conceptual understanding of storage infrastructure in this case is often helpful in making the right decisions when designing software. This is not something I see our students doing very often. That's unfortunate, because it's very helpful in strengthening their skills, and it's quite easy to do with GenAI. This kind of collaboration with GenAI could easily lead to a student being asked to create a presentation of their findings. This presentation will of course also be created using GenAI, but the exercise is not about the presentation itself, but about the understanding of the topic that a student shows when answering follow-up questions from peers or teachers based on the presentation.

Here's a link to the conversation.