Editing How AI Actually Works (section)

== The simplest explanation that's still true ==

Here's what happens when you send a message to ChatGPT, Claude, Gemini, or any other AI chat tool:
# '''Your message gets broken into tokens.''' The AI doesn't read words the way you do. It splits your text into small chunks called [[Glossary|tokens]] — sometimes whole words, sometimes pieces of words. The word "tokenization" might become "token" + "ization." This is why AI tools have limits on how much text you can send — they're counting tokens, not words. (For a deeper look at this, see [[Tokenization & Context Windows|Tokenization & Context Windows]].)
# '''Each token gets converted into numbers.''' The AI represents every token as a list of numbers (called an embedding) that captures its meaning and relationships. Words with similar meanings end up with similar numbers — "happy" and "joyful" are close together, "happy" and "wrench" are far apart.
# '''The model predicts what comes next.''' This is the core of it. The AI looks at all the tokens in your message, weighs how they relate to each other (this is the "attention" mechanism you might have heard about), and predicts the most likely next token. Then it predicts the next one. Then the next. One token at a time, until it has a complete response.

That's it. No understanding. No reasoning in the human sense. Pattern matching at a scale and sophistication that produces remarkably useful output — but pattern matching nonetheless.