181: Memory Management

Intro topic: Video Game Prices
News/Links:
Step one: Jump in the Lava - Abyssoft
https://youtu.be/WdadpHLAfdA?si=oXYnhB0EdkR_RaPE
Scalable world models for continuous control
https://www.tdmpc2.com/
Clever code is probably the worst code you could write - Engineer’s Codex
https://read.engineerscodex.com/p/clever-code-is-probably-the-worst
A new, open source text-to-speech model called Dia has arrived to challenge ElevenLabs, OpenAI and more
https://venturebeat.com/ai/a-new-open-source-text-to-speech-model-called-dia-has-arrived-to-challenge-elevenlabs-openai-and-more/
Book of the Show
Patrick
The Muscle Ladder - Jeff Nippard
https://amzn.to/44Dznsz
Jason
Metaphysics of War
https://amzn.to/4jMjvZ5
Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h
Tool of the Show
Patrick
Pokemon Trading Card Game Pocket
Jason
Phi-4
https://huggingface.co/spaces/microsoft/phi-4-multimodal
Topic: Memory Management
Motivation
Avoid thrashing / crashes
Allocate resources efficiently
Keep high uptime
Where
OS Level
Heap management
Virtual Memory
Language/Compiler Level
Cpp
Garbage collection
Ownership
Tools
Instrumentation
Export to Datadog / Grafana
Python: psutil & tracemalloc
Valgrind
What to do when your program uses too much memory?
Reduce data sizes
Compression
References
Lazy initializer
Generators & Back Pressure
Ring buffers
Arena allocators
Disk based caching
★ Support this podcast on Patreon ★