Coinbase CEO: AI spending reduced by nearly 50% while token usage continues to grow through methods such as using GLM models

Odaily Odaily News: Coinbase CEO Brian Armstrong posted on X platform, stating that Coinbase has reduced AI spending by nearly 50% while token usage continues to grow by optimizing default settings, routing, and caching strategies.

Specific measures include: switching the default model to open-weight models such as GLM 5.2 and Kimi 2.7, with 91% of employees never having reached usage limits before; preprocessing prompts in a custom system and automatically routing them to the most suitable model, enabling differentiated processing for planning and execution tasks; improving cache hit rate, increasing the LibreChat cache hit rate from 5% to 60%; streamlining context management by starting new sessions when switching tasks and narrowing file context scope; and enhancing spending visibility, allowing engineers to freely choose models but requiring them to bear the corresponding impact and expectations.