Inside a language model

A decoder-only transformer predicting the next word. Two of its many layers are drawn, and the numbers are illustrative.

Drag to orbit. Scroll to zoom. Hover a part.

Could not load Three.js from the CDN. Check the network connection and reload.