Loading
In this lessonBy the end, you’ll be able to
  • Distinguish generative AI from the classification and prediction AI you already encounter daily
  • Understand that generative AI's properties exist on a continuum from capability to limitation
  • Preview the four core properties you'll explore in depth: Next Token Prediction, knowledge, working memory, and steerability

What we mean by generative AI

Loading

What We Mean by AI · 4 min

SummaryTranscript

Most AI in the world (spam filters, recommendations, fraud detection) isn't generative. This course is about the kind that is: transformer-based text models that produce new content one token at a time.

Building a mental model of the machine

Loading

Key takeaways

  • Generative AI produces new content rather than classifying existing content.
  • AI isn't uniformly capable or uniformly unreliable. It's strong and weak along four predictable axes: Next Token Prediction, Knowledge, Working Memory, and Steerability.
  • Each property is a continuum. The same mechanism gives you both the capability and the limitation.
  • Calibrated trust means locating your task on the continuum, not granting or withholding trust wholesale.

Exercises

Generative or Not?

Why? You just learned that generative AI is fundamentally different from the AI that filters your spam and recommends your next video. Now you're going to use that distinction on your own experience.

  1. List five AI-powered features you've interacted with this week. Cast a wide net: autocomplete, photo tagging, spam filtering, chatbot answers, translation, product recommendations, voice assistants.
  2. For each one, jot down your call: is it producing new content, or is it sorting, ranking, and classifying existing content?
  3. Share your list with an AI and ask it to check your calls. For any you got wrong (or weren't sure about), ask it to explain the distinction in one sentence. Then ask: "Which of these five is most likely to have a failure mode this course will help me understand?"
  4. Go back to your Lesson 1 task list. For each task, tag it with the property question that feels most relevant right now:
    • Where do the answers come from? (Next Token Prediction)
    • What does it know? (Knowledge)
    • What's it paying attention to? (Working Memory)
    • How much am I in control? (Steerability)

You're not expected to get these right. You're creating predictions you'll test over the next four lessons.

Lesson reflection

  • Did the generative/classification distinction with AI change how you think about any tool you use?
  • Look at how you tagged your task list. Did any task feel like it could belong under more than one property?

What's next

Before we dig into the four properties, we'll spend one lesson on how an AI system ends up with a personality at all. Why it's polite, helpful, honest, why it sometimes agrees too easily, why it declines certain things. That shaping process leaves fingerprints on everything that follows.