Same answers.Fewer tokens.
One API call before your model call: send the prompt, get it back shorter, pass it on. Nothing else in your code changes. Nothing is rewritten, only removed, and you pay only for the tokens we remove.
Private beta, access by requestWorks with any model
Azure OpenAI
Context infrastructure built to evolve
Our own compression models mean we adapt as fast as models change. Agents. Million-token contexts. Whatever comes next.
One call before the model
- One call, before the model
- POST the prompt to Tokeen, get it back shorter, send it to your provider as usual. No SDK, no wrapper
- Nothing else changes
- Your provider, your models, your client code, your streaming: all untouched
- Only removes, never rewrites
- The text that comes back is your text, verbatim and in order, minus what the answer does not need
- Deterministic
- Same input, same rate, same output. Your prompt caches keep working
- Pay only for what is removed
- The meter counts removed tokens. If we cannot compress, the call is free
Designed for every context
Tool results are re-read on every turn of an agent loop. Compress a result once, before it enters the context, and every following turn gets cheaper.
- Compress once, re-read shorter on every turn
- Code, JSON and citations kept verbatim
- Deterministic, so cached prefixes stay stable
POST /v1/compress
{
"text": "<tool result, 14,512 tokens>",
"rate": 0.6
}{
"text": "<compressed tool result>",
"tokens_in": 14512,
"tokens_out": 6966,
"tokens_removed": 7546,
"billed_tokens": 7546
}Measured, not promised
- Compressing by 20 % is free. Compressing by 50 % is not.−20 %tokens, same answers
- Where a tool-using agent's money goes64 %of cache reads are tool results
- One real invoice: $2.2k a month of LLM, and what compression gets back10 %cache-hit rate found
Frequently asked questions
What people ask before they request access, written down. Missing one? Ask us.
Request accessPrompt compression cuts the number of tokens in an LLM prompt or context while preserving its meaning, so the same request uses fewer tokens and costs less.
Tokeen finds the most token-efficient way to represent your text: every bit of signal stays, the rest goes. It is deterministic and nothing is summarised or rewritten, so what comes back is your text, verbatim and in its original order, minus what the answer does not need.
Stop paying for filler. One call before the model, billed only on what we remove.
Tokeen is in private beta. Request access and measure it on your own prompts.