What is Tokenization in AI?
Models do not read words, they read tokens. What tokenization is, why it decides your API bill, and why the same sentence costs 118 percent more in Japanese than in English.
What is Hallucination in AI?
When AI gets it wrong, in order 1What it isYou are here: Hallucination, and why a model invents things 2Why it happensWhy a confident tone reads as truth 3Spot itThree tells, before the mistake costs you 4Fix itWhat to do once ChatGPT has already got it wrong Already had the problem? Jump to step four….
How Do Language Models Work? I Built One Small Enough to Watch
The usual one-sentence explanation of a language model is that it predicts the next word. That is correct, and on its own it settles nothing, because it skips the two parts that would tell you how the thing behaves. What does a prediction look like before a word comes out of it? And what does…
Prompt Engineering for Beginners: What the Research Actually Shows
Prompting, in three steps 1Start hereYou are here: What a prompt is, and the mistakes everyone makes first 2The techniquesPatterns that reliably improve the output 3Go deeperChain of thought, few shot, and where prompting stops New to this? Start at step one. It takes four minutes. Most prompting advice arrives as a list of five…
