Model routing with Google Cloud API Gateway
Summary
Google Cloud API Gateway now offers a model routing feature in Public Preview, allowing developers to dynamically route traffic to models like Gemini, Claude, or OpenAI OSS-GPT without hardcoding endpoints or managing open-source proxies. Developers can easily configure these routing rules directly within their OpenAPI 3.x specifications by mapping virtual model names to specific backend targets on a shared host. Once deployed, the Gateway acts as a serverless ingress layer that accepts standard OpenAI-compatible requests, automatically transcodes the payload to the native schema of the target model, and routes the…
Related: OpenAI: Introducing GPT-6 Astra: the most intelligent and aligned model in the world. · Anthropic: GPT‑6 Astra · Microsoft: Meet MAI-Transcribe-2: A faster and more accurate speech recognition model · Meta: MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet · xAI: Sam Altman "AGI by December"
Rated low: routine. Worth knowing, not worth rearranging your day for.
- Google’s latest AI weather model gives you no excuse to forget your umbrellaTechCrunch AI · Web · Sep 3, 2026
- Google says its new Gemini 3.8 Flash model ‘works harder’ but might cost moreThe Verge AI · Web · Sep 2, 2026
- Google releases Gemini 3.8 Flash, its third Flash model in six weeksArs Technica AI · Web · Sep 2, 2026
- llm-gemini 0.34Simon Willison · Web · Sep 2, 2026
- Claude Fable 5.1 made me a really nice animated pelicanSimon Willison · Web · Sep 1, 2026
- The Most Overhyped and Underhyped New AI ModelsMatt Wolfe · Web · Sep 2, 2026
- Mastering Edge AI on Raspberry Pi with LiteRT and GemmaGoogle Developers Blog
- Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPUGoogle Developers Blog
- Why Go is an Ideal Language for AI-Assisted Software EngineeringGoogle Developers Blog
Questions people ask
- Where can I read the full story?
- On Google Developers Blog. The "Read this on Google Developers Blog" link above opens the original in a new tab. Subvolts publishes a summary and analysis, never the full piece.
- What does this mean for Gemini?
- Google Cloud API Gateway now offers a model routing feature in Public Preview, allowing developers to dynamically route traffic to…
More from Google Developers Blog 16 more
Agent and Model Evaluations in Gemini Enterprise Agent Platform are now GA
Page generated Sep 3, 2026. Summaries are Subvolts' own; the story belongs to Google Developers Blog.