StateHead
A small recurrent language model, trained on my Mac, and what I learned about the limits of a four-kilobyte memory.
Sam Neill Furr
I use this site to document my projects: software, machine learning, and the occasional thing made by hand.
Writing
Replacing Linear Attention Projections With Learned Rotations
An experiment replacing attention’s large projection matrices with learned rotations, translations, and scales.
FoveatedKV
Keeping the parts of an LLM’s memory it pays attention to in high precision, with a Metal kernel for Apple Silicon.
Stool Project
From a basement CNC machine to a plywood and aluminum stool, made for friends and shipped in a custom hexagonal box.
Sculpture Project (Scalable multiplayer platform)
A multiplayer platform built with Rust, WebSockets, and Redis, designed to connect players across cloud regions.
Go, Grandpa!
A playful mobile sidescroller inspired by the Flash games my friends and I grew up playing.
Home k8s/ceph Cluster
Seven small computers, redundant storage, battery backup, and a walnut case: a home for my growing collection of projects.
Homebrew CPU
Building an eight-bit processor from logic chips, starting with registers, an arithmetic unit, and a bus.
How do you feel? (social platform)
Exploring the design and development of a social platform with Ruby on Rails and PostgreSQL.
Last.fm top 10 (data aggregator)
A weekend project visualizing how the artists in a Last.fm weekly top ten change over time.
Mobile Design Study
Taking a mobile app from early sketches through successive visual designs and prototypes.
Speeks (socket-based web chat)
A real-time web chat built with Node.js and Socket.IO, without storing conversations on the server.
Transistor Logic Gates
Learning circuit design by building individual logic gates from transistors and resistors.