r/AI_Agents on Reddit: What do you use for large scale AI agents deployment & management ?

Using terraform and only frontier models accessible in major cloud providers via APIs. No local models. Update via normal DevOps pipelines. Testing prior to release is a bit more challenging than traditional SW due to non-determism in request/response. Tool deployment follows traditional SW dev processes. More on reddit.com