Unified Count Tokens Endpoint!

We’ve introduced a single endpoint for counting tokens across AWS Bedrock, Vertex AI, and Anthropic.

This makes it easier to:

• Get an estimate of tokens before sending the request

• Manage rate limits and costs

• Enforce routing and quota rules inside your app

• Optimize prompts to be a specific length

Read more here ->