We're excited about cross-layer transcoders both as tools for reconstructing computational circuits in LLMs and as high-quality feature libraries for unstructured text data. There aren't a lot of open-source CLTs available, so we trained a couple for members of the Qwen3 family to fill in that gap. Link is to a dashboard for exploring the features, including topological maps of the feature space. The models themselves are available on Hugging Face: https://huggingface.co/collections/bluelightai/qwen3-cross-l...
1 comment
Show HN: Cross-Layer Transcoders for Qwen3 | Heykuki News