← All articles AI productivity · Developers

Making a small language model behave like a Mythos

What the biggest AI models do better and simple ways to get similar results from a smaller model.

13 min read

The most powerful AI models, like Anthropic’s Claude Mythos and OpenAI’s GPT-6 Astra, often cost five times as much to use, or more, as the everyday models most of us rely on, like Claude Sonnet, OpenAI’s GPT-5.6, or Google’s Gemini Flash. (Sources: Anthropic, OpenAI, and Google price lists.)

But the gap is smaller than the price suggests. Give a cheaper model a clear ask, the right facts, and a quick check, and it can get close. Below are the simple tips, with real before-and-after prompts you can copy today.

What do the top AI models do better?

  1. Staying on track. A top model can keep working on a long task without losing the thread. METR, an independent research group, estimated that an early version of Mythos succeeds about half the time on tasks that take a skilled person 16 hours or more, and said it cannot measure reliably beyond that. (Source: METR, as reported by The Decoder.) Smaller models tend to lose the thread sooner.
  2. Knowing more. A bigger model holds more facts, especially about niche topics. A smaller one knows less, so it is more likely to guess, and a guess can sound just as confident as a fact.
  3. Hard problems. On Anthropic’s own tests, Mythos beats the company’s earlier top models on difficult coding, science tasks, and expert-level exam questions. (Source: Anthropic’s launch announcement.)
  4. Checking its own work. Anthropic says Mythos is better at verifying its own work before handing it back. (Source: Anthropic’s launch announcement.)

Where the gap barely matters

For a lot of daily work, a smaller model is already enough: rewriting an email, summarizing a page, fixing grammar, turning notes into a list, pulling names and dates out of a document. These jobs are short and clear, and the answer is easy to check.

The companies say so themselves. Anthropic advises Haiku for simple tasks, Sonnet for most work, and its larger models for the most complex reasoning. Google describes its Pro model as the one that excels at coding and complex reasoning, and sells cheaper Flash and Flash-Lite models alongside it. (Sources: Anthropic’s pricing guide, Google’s price list.) A good rule: start with the smaller model. Switch to the big one when the job is long, hard, or a mistake would be expensive.

Tips for better prompts

  1. Say exactly what you want. Don’t leave it to guess. Include who it is for, how long it should be, and what it should sound like. Anthropic’s first general rule of prompting is to be clear and direct, and to think of the AI as a brilliant new employee who lacks context on your work. (Source: Anthropic’s prompting guide.)
  2. Give it the facts. Don’t make it rely on memory. Paste in the few facts it needs, like prices, dates, or the details of your situation. Google’s guide puts it plainly: include the information the model needs instead of assuming it already has it. (Source: Google’s prompting guide.)
  3. Tell it what to do when it doesn’t know. Add one line: “If the answer isn’t in what I gave you, say so.” Anthropic says giving the AI permission to admit it doesn’t know can drastically reduce made-up answers, which AI experts call hallucinations. (Source: Anthropic’s guide to reducing made-up answers.)
  4. Show an example. If you want a certain style or format, paste one you like and say “like this.” Anthropic calls examples one of the most reliable ways to steer the format and tone of an answer, and Google recommends always including them. (Sources: Anthropic’s prompting guide, Google’s prompting guide.)
  5. Give all the details up front. Put the full picture in your first message instead of adding details bit by bit. In one study by Microsoft and Salesforce researchers, AI answers got 39 percent worse on average when the same task was spread over a back-and-forth conversation, and once a model took a wrong turn, it rarely recovered. (Source: Microsoft and Salesforce research paper.)

Tips for a better workflow

  1. Break big jobs into small steps. Don’t ask for a whole report in one go. Ask for an outline, then one section at a time. Small steps are where small models do their best work, and OpenAI and Google both recommend splitting complex tasks this way. (Sources: OpenAI’s prompting guide, Google’s prompting guide.) For each step, still give all the details it needs in one message.
  2. Let it think first. For harder questions, add “Think this through carefully before you answer,” and turn on your app’s “thinking” option if it has one. Anthropic’s guide says a simple instruction like “think thoroughly” often works better than spelling out every step yourself. (Source: Anthropic’s prompting guide.)
  3. Start a fresh chat when it drifts. Long conversations get worse over time, because early mistakes stick around. That is the same study again: models that go wrong early tend to stay wrong. Ask for a short summary of where you are, open a new chat, and paste it in. I wrote more about this in context rot.
  4. Keep your important material outside the chat. If the only copy of an important fact, link, or screenshot lives in an old conversation, you will put off starting fresh, even when you should. Keep it somewhere you can grab it and paste it back in.
01Plan. Break the job into small steps.
02Do one step. With the facts it needs.
03Check it. Before moving on.
04Drifting? Summarize and start fresh.

Tips for better results

  1. Ask it to check its answer. “Now check your answer against the facts I gave you. List anything that doesn’t match.” Anthropic recommends this kind of second pass for catching mistakes. (Source: Anthropic’s guide to reducing made-up answers.)
  2. Check with something that can’t be fooled. A calculator for numbers. Clicking the link. Running the code. Reading the source it quoted. Don’t just ask the AI if it is sure. Even Anthropic says to always check important information yourself.
  3. Ask more than once. Ask the same question two or three times, or ask for three versions. If the answers disagree, treat that as a warning sign that it may be guessing. If you are writing, just pick the best draft. (Source: Anthropic’s guide to reducing made-up answers.)
  4. Know when to switch up. If the smaller model gets the same thing wrong twice, stop rewording. Hand that one step to a bigger model, then come back.

See it in action

01 / 06
Tip · Say exactly what you want
Instead ofWrite an email to my landlord about the tap.
TryWrite a short, polite email to my landlord asking for the leaking kitchen tap to be fixed by Friday. It has been leaking for two weeks. Keep it under 100 words.

Why it works It knows the goal, the tone, the deadline, and the length, so it doesn’t have to guess.

Tip · Give it the facts, and a way out
Instead ofA customer asked if our carrot cake is nut-free. Write a reply.
TryOur carrot cake contains walnuts. The lemon loaf is nut-free. A customer asked if the carrot cake is nut-free. Write a friendly reply. If anything isn’t covered here, say we’ll check.

Why it works Without the facts, it might cheerfully say “Yes, it’s nut-free!” With them, it answers from your facts, not its memory.

Tip · Show an example
Instead ofWrite a caption for our café’s new lemon loaf.
TryWrite a caption for our café’s new lemon loaf. Match the style of this one we liked: “Monday, fixed. Cinnamon buns, warm from 7am.” One line, no hashtags.

Why it works One example shows the tone and length better than any description can.

Tip · Give all the details up front
Instead ofHelp me plan a trip to Kyoto. (Then five more messages adding the details.)
TryPlan a 3-day trip to Kyoto for two adults in April. Our budget is $1,500, not counting flights. We love food and walking, and we’re not into nightlife. Give us a day-by-day plan.

Why it works It plans around your needs from the start, instead of patching a first draft that was built on guesses.

Tip · Break big jobs into steps
Instead ofWrite a business plan for my dog-walking business.
TryI’m starting a dog-walking business. First, just give me an outline of the sections a simple business plan needs. We’ll write each section after that.

Why it works Smaller steps mean fewer mistakes, and you can steer after each one.

Tip · Check the answer
Instead ofCopying the first reply straight into your email.
TryNow check your reply against the facts I gave you. List anything that doesn’t match, then fix it.

Why it works A second pass catches mistakes. For anything important, check it yourself too.

Does this really work?

Yes. Researchers have shown that a much smaller model, given the right help, can beat a giant on a clear task.

Practice with right or wrong answers Researchers at UC Berkeley took a very small AI model, small enough to run on a laptop, and had it practice about 40,000 math problems. After each one, it was told only whether its answer was right or wrong. After that practice, it scored higher than OpenAI’s o1-preview, one of the best AI models of 2024, on a hard US math competition. (Source: UC Berkeley researchers’ model page.)
Looking things up Researchers at Meta built a model called Atlas that searches Wikipedia before it answers. On a quiz of real questions people had typed into Google, it beat Google’s own PaLM, a model about 50 times bigger that had to answer from memory. (Source: Meta research paper.)
Both come back to the tips above: give the AI the facts, and check its answers against something reliable.

There are limits. A smaller model still knows less, and it still struggles with something truly new or a job that runs for hours with nobody watching. For those, the big model earns its price.

The checklist

Before you reach for the biggest model
  • Did I say exactly what I want? Who it is for, how long, and what tone. Why: the AI can’t read your mind, so it fills any gaps with guesses.
  • Did I give all the details up front? Why: when details arrive bit by bit, the AI locks onto its first guess and rarely lets go.
  • Did I paste in the facts it needs? Why: if it has to rely on memory, it may make something up.
  • Did I tell it to say “I don’t know”? Why: otherwise it may guess, and a guess can sound just as sure as a fact.
  • Is this one small job? If not, split it into steps. Why: AI does its best work on one clear task at a time.
  • Is this chat getting long? Ask for a summary and start a new chat. Why: old mistakes linger in long chats and quietly affect new answers.
  • Did I check the answer myself? With a calculator, the original source, or by trying it. Why: AI can sound confident and still be wrong.

Your copy-and-fill prompt template

Prompt template
ROLE: Act as [the expert you need, e.g. a friendly customer service writer]. GOAL: [What you want, in one sentence] WHY: [What it is for, so you can make good choices] AUDIENCE: [Who will read or use it] CONTEXT (use only this): """ [Paste the facts, notes, documents, or data it needs] """ EXAMPLE of what good looks like: """ [Paste one example you like, or delete this section] """ OUTPUT: - Format: [e.g. email, bullet list, table] - Length: [e.g. under 100 words] - Tone: [e.g. friendly, plain English] GUARDRAILS: - Only use the context above. If something isn’t covered, say “I don’t know” instead of guessing. - Don’t invent names, numbers, quotes, links, or sources. - If anything is unclear, ask me up to 3 questions before you start. - Point out anything you’re unsure about, so I can double-check it. - Don’t change anything I didn’t ask you to change. DONE MEANS: [How you will judge it, e.g. the landlord knows what is broken and the deadline] PROCESS: 1. Think it through carefully before you answer. 2. Write the answer. 3. Check it against the context and DONE MEANS. List anything that doesn’t match, then fix it.

Where Tansei fits

Almost every tip above comes down to one thing: context. The facts, the example, the summary you carry into a fresh chat, the source you check the answer against. Give a model the right context and even a small one does good work. Leave it guessing and even the biggest one can go wrong.

That is why I built Tansei. It is a simple shelf for Mac and Windows that sits at the edge of your screen and keeps your working context in one place: the screenshots, links, notes, snippets, and files you are using right now. When you write a prompt, drag in exactly what the AI needs. When a chat drifts, start a fresh one without losing anything. It works the same with any AI, big or small, because it lives beside every app.

Everything stays on your computer, and there is no account.

Get Tansei for Mac and Windows

Frequently asked questions

What is Claude Mythos?

Claude Mythos is Anthropic’s top AI model. Its latest version, Mythos 5.1, came out on September 1, 2026. It is invitation-only, for approved organizations doing work like cybersecurity and life sciences. Claude Fable is the same model with extra safety limits, and anyone can use it.

What is the difference between Claude Mythos and Claude Sonnet?

Mythos is Anthropic’s top model, built for long and complex work. Sonnet is a smaller, faster model that costs about a fifth as much and handles most everyday tasks well. The gap shows up mostly on long, hard, or multi-step jobs.

Do I need the most powerful AI model for everyday tasks?

Usually not. Emails, summaries, rewriting, and simple research work well on smaller models. Anthropic, for example, suggests Haiku for simple tasks and Sonnet for most work. Use the biggest model when the job is long, hard, or a mistake would be costly.

How do I get better answers from a cheaper AI model?

Be specific about what you want, give all the details up front, paste in the facts it needs, and tell it to say when it doesn’t know. Break big jobs into small steps, start a fresh chat when it drifts, and check the result with something other than the AI.

Why does AI make things up (hallucinate)?

When a model doesn’t know the answer, it often produces something that sounds right instead of saying so. This is called hallucinating, and the made-up answer is called a hallucination. It happens with every AI model, big or small, but models that know less have more gaps to fill. Giving it the facts and telling it to admit when it doesn’t know both reduce hallucinations.

How can Tansei help me get better results from AI?

Tansei keeps your working context in one place: the screenshots, links, notes, snippets, and files you are using right now. That makes it easy to give any AI model, big or small, the facts and examples it needs, to start a fresh chat without losing your material, and to check answers against the original source.

Back to top
Keep reading7 min AI productivity Ten ways to get better results from AI Read the article Also worth your time10 min AI productivity Context rot: why more context can make AI worse Read the article