Research
Longer-form research on language models, AI systems, and the infrastructure underneath them.
How parameter count and numerical precision determine memory footprint, where models can run from smartphones to microcontrollers, and what llama2.c and llama.cpp show about local inference.