Why cached tokens are so cheap
AI APIs charge as little as a tenth, sometimes a fortieth, of the normal input price for tokens they have seen before. The discount comes from skipping work the GPU already did. Most providers cache automatically, and keeping what changes at the end of the prompt gets you more hits. A cache hit only means your own organization sent the same prefix, although a 2025 audit found seven providers where caches were shared across users.
Read more
