Forward-looking: It's no secret that generative AI demands staggering computational power and memory bandwidth, making it a costly endeavor that only the wealthiest players can afford to compete in.

Context windows are becoming a computational bottleneck. The longer an agent runs, the more tokens accumulate from retrieved documents, reasoning traces and conversation history, and the more memory ...