Show HN: A new alternative to Softmax attention – live GD-Attention demos

2 points

10 months ago

We built two live demos to illustrate the Ghost Drift Theory — a framework for modeling semantic coherence — and a new attention mechanism called GD-Attention.

• Part 1 — Semantic Energy Landscape: Visualize the unique coherence point s* and jump direction g in real time. • Part 2 — GD-Attention vs Softmax: "Softmax blends, GD-Attention selects" — explore the difference interactively.

Paper (with Zenodo DOI): [Ghost Drift Theory & GD-Attention PDF](https://zenodo.org/records/16757311) ▶ Part 1: https://gdt-semantic-energy-demo-jdgoe6gkrohleltjgvwgwq.stre... ▶ Part 2: https://gda-vs-softmax-demo-zooif4cfewrmnv85zaqymy.streamlit...

Would love feedback on clarity, use cases, and potential improvements.

1 comment