What we mean by generative AI
What We Mean by AI · 4 min
Most AI in the world (spam filters, recommendations, fraud detection) isn't generative. This course is about the kind that is: transformer-based text models that produce new content one token at a time.
Building a mental model of the machine
Key takeaways
- Generative AI produces new content rather than classifying existing content.
- AI isn't uniformly capable or uniformly unreliable. It's strong and weak along four predictable axes: Next Token Prediction, Knowledge, Working Memory, and Steerability.
- Each property is a continuum. The same mechanism gives you both the capability and the limitation.
- Calibrated trust means locating your task on the continuum, not granting or withholding trust wholesale.
Exercises
Generative or Not?
Why? You just learned that generative AI is fundamentally different from the AI that filters your spam and recommends your next video. Now you're going to use that distinction on your own experience.
- List five AI-powered features you've interacted with this week. Cast a wide net: autocomplete, photo tagging, spam filtering, chatbot answers, translation, product recommendations, voice assistants.
- For each one, jot down your call: is it producing new content, or is it sorting, ranking, and classifying existing content?
- Share your list with an AI and ask it to check your calls. For any you got wrong (or weren't sure about), ask it to explain the distinction in one sentence. Then ask: "Which of these five is most likely to have a failure mode this course will help me understand?"
- Go back to your Lesson 1 task list. For each task, tag it with the property question that feels most relevant right now:
- Where do the answers come from? (Next Token Prediction)
- What does it know? (Knowledge)
- What's it paying attention to? (Working Memory)
- How much am I in control? (Steerability)
You're not expected to get these right. You're creating predictions you'll test over the next four lessons.
Lesson reflection
- Did the generative/classification distinction with AI change how you think about any tool you use?
- Look at how you tagged your task list. Did any task feel like it could belong under more than one property?
What's next
Before we dig into the four properties, we'll spend one lesson on how an AI system ends up with a personality at all. Why it's polite, helpful, honest, why it sometimes agrees too easily, why it declines certain things. That shaping process leaves fingerprints on everything that follows.