Regional inference now available on AI Gateway
AI Gateway now supports regional inference. Set on a request to pin it to the US or EU. Every model provider that supports the selected region handles it the same way. Inference runs there, and any data the provider keeps is stored there.inferenceRegion AI Gateway supports two pinned regions, plus…
No discussion yet. Be the first to share your thoughts!