I built Wasda, a tiny experiment to turn transformer attention into a playable musical instrument. Each token in the sequence becomes a piano note, and you can see the attention arcs between tokens while you listen. Temperature controls the “improvisation” of the model, and you can solo individual attention heads — for example, I’ve found temp ~1.7 with one head selected gives surprisingly relaxing patterns.
Show HN: Wasda – Experience transformer attention as music | Heykuki News