# Groking Transformers 1/4 - basic intuitions and understanding core logic & math Get a **deep intuition + understanding** of the **logic, math & code** behind a transformer neural network. > define:**grok** /ɡrɒk/ verb | informal | US > - to understand intuitively or by empathy, to establish rapport with > - **"When you grok something, you just get it — in other words, you *totally* grasp its meaning."** > - **"When you claim to 'grok' some knowledge or technique, you are asserting that you have not merely learned it in a detached instrumental way but that it has become part of you, part of your identity."** SEE [[groking-transformers-series-intro]] for a proper explanation of how and why I ended up writing this. ## Origins - RNNs were not good enough ... ![[Drawing 2023-09-19 12.37.51.excalidraw.png]] **Fig. 1** - RNN seq-to-seq bottleneck issue