Release Notes: Adaptive Token Compressor#

Version 2026.2#

Release Date: September 9, 2026

Summary:

Initial release of the Adaptive Token Compressor — a pluggable compression library purpose-built for LLM agent systems. Using a single unified interface, it compresses system prompts, context, and tool schemas across an LLM agent pipeline to reduce token usage and improve inference efficiency.

Features:

  • Unified compressor API with two compression types: conversation messages (harness) and tool descriptions (tool)

  • Factory-based construction for drop-in integration as a plugin in other projects

  • LLMLingua-backed text compression for local Lingua Server backends (PyTorch/OpenVINO)

  • LLM-based tool selection through a configurable predictor endpoint

  • Hybrid rule-based and model-based compression to balance compression ratio and content fidelity

  • Configurable tool-injection placements to flexibly trade off token savings against prefix-cache hit rate

  • Per-compressor telemetry for tokens, savings, compression ratio, and latency, with cross-compressor aggregation through CompressionManager