LLM Self Atention Mechanism
This interactive demo and simulation helps you understand the attention mechanism, which is at the core of transformers, which are again at the core of generative AI engines that help generate the relevant outputs that which have been their name to fame
Preview includedLog in to interact with the simulation
Make changes. See results. Learn faster.
Unlock this interactive simulation
Log in or create a free account to run the simulation, move every control, and see the results change in real time.
Run the full simulation
Adjust every input and watch it respond live.
Learn by breaking it
There's no wrong input — that's where the learning is.
One tab, zero setup
Runs right in your browser, nothing to install.
More interactive simulations
Unlock the rest of the library once you're in.
Free to explore. No credit card required.
Already have an account? Log in
Learn by doing
Interactive simulations for practical understanding.
Still early, growing fast
New simulations land regularly during the beta.
Built for clarity
Simple, visual, and beginner friendly.