Pocket GPT

Pocket GPT is a real GPT, the same design as the chatbots you know, shrunk until you can watch every part of it work. It lives entirely in this page, starts out knowing nothing, and you'll teach it to write.

    💬 Chat

    Type anything and send it. It picks up where you leave off, one letter at a time, each one chosen from its own guesses.

    Ask it a question. It writes its answer one letter at a time and stops at the end of the line, the way every answer it has read ends. Chatting never teaches it anything: only training changes its numbers.

    Your starting text. ↵ means a new line. Characters it has never seen in its training text are ignored.

    What it actually reads: That is how its training text writes a question, and its answer is whatever it writes after a:.

    Creativity

    Creativity (the pros call it temperature): low plays it safe and always takes its top guess, so it gets repetitive. High takes long shots, so it gets surprising, then weird, then nonsense.

    Its next-letter guessesHow its answer starts

    After your text, these are the letters it thinks could come next. The bigger the letter, the surer it is. Click any letter to type it for it, and watch its next guesses change.

    After your question, these are the letters it thinks its answer could start with. The bigger the letter, the surer it is. Type a different question and watch them change.

    Less likely

    📚 Feed it

    Pick what it will learn from. Everything it will ever know comes from this one text.

    Pick a text above, or paste your own: song lyrics, a recipe, your emails. A few pages is plenty. Questions and answers written like Pocket Pal’s turn it into a chatbot. Press Learn from this text when the box holds what you want it to learn.

    Train it

    It learns from the text you fed it. Every step it reads a snippet, covers the next letter, guesses, peeks, and nudges its numbers a little. Press Train and watch static turn into your text's voiceright answers. Pause whenever you like, and save it to your lab when its writing makes you smileanswers come out right.

    step 0loss —right —— numbers
    ›Brand new: its numbers are random, so it knows nothing yet.

    Snapshot of its writing, every 20 seconds

    Press ▶ Train. The first snapshot lands in a moment.
    Creativity0.80

    Telemetry how wrong it is

    ⏳now
    Flight log
    1. Samples appear here as it trains.

    Its writingIts answers

    Nothing yet. Press ▶ Train.

    Reading

    guess
    actual
    Press TRAIN, or Slow-mo for one step.

    Next letter

    after

    Attention

    Heads

    Landscape

    zoom
    It maps itself once it has learned a little.

    Letter map

    Hover a letter to see which letters it thinks are most alike.

    X-ray

    numbersnudges

    🧠 Saved brains

    Keep a brain you trained, come back to it later, or send it to a friend as a file.

    Saved brains live in this browser only. A downloaded file holds its numbers, its alphabet, its shape and the text it learned from, so anyone can load it here and carry on training where you left off.

    🧪 Your lab

    Keep training, keep chatting, save the brains you like, or start again with a new text.

    What you learned, in nine lines
    1. It only knows what it reads. Its whole world was one text.
    2. It starts as random numbers, which is why it babbled.
    3. Training is guess, check, nudge, thousands of times.
    4. Writing is one guess at a time, picked from letters like the ones you clicked.
    5. Creativity is how far down the list it's allowed to pick.
    6. Attention heads each look back for different clues, and switching one off shows what it was for.
    7. Learning is rolling downhill through a space with thousands of directions.
    8. Everything it knows is just numbers: no rules, no dictionary.
    9. A bigger brain is a new brain: it has to learn from zero.

    Questions

    What is Pocket GPT?
    Pocket GPT is a real GPT, the same design as the chatbots you know, shrunk small enough to watch every part of it learn.
    Where does Pocket GPT run?
    Pocket GPT runs entirely in this page, with no server, no API and no library. It starts out knowing nothing, and a few pages of text are plenty to teach it.
    How do I train Pocket GPT?
    Pick a text for Pocket GPT to learn from, press Train, and watch static turn into your text's voice.