The Best Infrastructure for Running AI Agents
OpenAI Agents API vs Amazon Bedrock Managed Agents vs Google Vertex AI Agent Engine vs Microsoft Foundry and Agent Framework vs self-hosted stacks.
Google Vertex AI Agent Engine leads this edition by one point because it combines a mature managed runtime with memory, sessions, code execution, observability, identity controls and broad framework support. OpenAI Agents API is the fastest route to the Codex harness and ranks first for developer velocity, but its public-beta status and narrower enterprise control surface keep it just behind.
Microsoft is the strongest choice for enterprises already committed to Azure and Microsoft 365. Amazon Bedrock Managed Agents offers the most direct route to OpenAI agents that run inside AWS, although its preview status is a material production constraint. Self-hosted frameworks remain the control and portability winner, but teams pay for that freedom through engineering, security and reliability work.
The 2027 ranking
| Rank | Runtime category | DN score | Best for | Main constraint |
|---|---|---|---|---|
| 1 | Google Vertex AI Agent Engine | 88/100 | Production-grade, framework-flexible enterprise agents | Google Cloud complexity and metered auxiliary services |
| 2 | OpenAI Agents API | 87/100 | Fast deployment of long-running Codex-harness agents | Public beta and OpenAI-centric managed experience |
| 3 | Microsoft Agent Framework + Foundry | 85/100 | Azure, Microsoft 365 and governed enterprise workflows | Large product surface and more architectural choices |
| 4 | Self-hosted frameworks | 81/100 | Maximum control, model choice and infrastructure portability | Highest operational and security burden |
| 5 | Amazon Bedrock Managed Agents | 80/100 | AWS-native OpenAI agent deployments | Preview availability and regional limits |
Important: These are evidence-based readiness scores, not claims of measured latency or task-completion superiority. A two-point difference is not statistically meaningful. Readers should use the adjustable tool below to model their priorities.
Google Vertex AI Agent Engine
Best balance of runtime maturity, governance, memory, framework support and observability.
OpenAI Agents API
The shortest path to durable agents powered by the managed Codex harness.
Microsoft stack
Strongest fit where Azure identity, Foundry, Teams and Microsoft 365 already dominate.
Self-hosted
The ceiling is highest, but so is the responsibility for uptime, isolation and governance.
Question: Which runtime is most ready to operate persistent, tool-using AI agents in production?
Evidence window: Public product documentation and announcements available through 8 October 2026.
Included: Managed execution, state and memory, tools and protocols, security, observability, deployment, model portability, operational control and price transparency.
Not yet included: DN-operated latency, recovery, adversarial-security or cost-per-successful-task tests. Vendor testimonials are not treated as independent benchmark results.
What is a managed agent runtime?
A model API generates outputs. An agent runtime keeps a goal-directed system operating across many model calls, tool invocations and interruptions. It may preserve session state, compact context, retry failed actions, isolate code, coordinate specialist agents, store memories, trace decisions and enforce identity or permission policies.
This distinction matters because an apparently more intelligent agent may actually be benefiting from a better harness. Context management, tool routing, recovery and sandbox design can change real-world task completion without any change to the underlying model.
The 2027 infrastructure contest is therefore not simply OpenAI versus Gemini or one foundation model versus another. It is a contest among complete execution systems.
DN Runtime Fit Calculator
Build your own runtime ranking
Move the sliders to reflect what matters to your organization. The calculator normalizes your priorities and reranks all five options.
Decision-support tool only. Scores describe documented readiness as of the evidence date and do not guarantee performance, availability or regulatory suitability.
1. Google Vertex AI Agent Engine: best overall
Google's managed agent layer, increasingly presented within the Gemini Enterprise Agent Platform, offers a serverless runtime plus Sessions, Memory Bank, code execution, tracing, logging, monitoring and identity controls. Its documentation supports Google's Agent Development Kit as well as LangChain, LangGraph, LlamaIndex, AG2 and A2A agents.
That breadth is strategically important. A company can use Google infrastructure without committing every orchestration decision to a Google-only framework. Agent identity, service accounts, IAM conditions, private connectivity and Agent Gateway also give security teams recognizable control points.
Why it leads
- Broad framework and A2A support.
- Managed sessions and long-term memory.
- Integrated tracing, logging, monitoring and evaluation.
- Secure managed code execution and computer-use direction.
- Clearer component pricing than several rivals.
Where it can disappoint
Capability breadth creates configuration overhead. Costs can also fragment across runtime compute, memory, stored session events, Memory Bank retrieval, models and tools. The platform is most compelling for teams already equipped to manage Google Cloud IAM, billing and network architecture.
2. OpenAI Agents API: best for developer velocity
The Agents API exposes the Codex harness as an OpenAI-managed service. OpenAI manages sessions, orchestration, context compaction and recovery. Agents can execute code, edit files, use custom functions, search the web, connect to MCP servers and operate in hosted or partner execution environments.
Its most important advantage is integration. Long-running sessions, tool search, programmatic tool calling, subagents and computer use are parts of one opinionated system rather than an assembly project.
Why it nearly wins
- Fast path from prototype to durable cloud agent.
- Open-source Codex harness provides visibility into core orchestration logic.
- MCP, custom tools, web search, computer use and subagents.
- Choice of OpenAI-hosted, customer-managed or partner sandbox environments.
- No separate Agents API fee during the reviewed public-beta offer; tokens and paid tools remain billable.
The trade-off
The service was still in public beta at the evidence cut-off. OpenAI manages important orchestration behavior, which accelerates delivery but reduces direct operational control. Organizations should verify data residency, support, quotas, tool isolation and migration requirements before treating it as a default for regulated workloads.
3. Microsoft Agent Framework and Foundry: best Microsoft ecosystem fit
Microsoft's offering has two related layers. Microsoft Agent Framework is the open-source successor to AutoGen and Semantic Kernel, combining multi-agent abstractions with state management, type safety, middleware, telemetry and deterministic workflows. Foundry Agent Service adds hosted agents, managed compute, tracing, evaluation, identity and publishing into Microsoft channels.
The framework supports sequential, concurrent, handoff, group-chat and manager-directed orchestration patterns. Graph-based workflows can checkpoint state, survive interruption and incorporate human approval.
Why enterprises will choose it
- Natural fit with Azure identity, networking and governance.
- Open-source framework with Python, .NET and Go support.
- Explicit workflows for deterministic and human-in-the-loop processes.
- Hosted runtime available across a wide regional footprint, including South Africa North.
- Distribution into Teams, Microsoft 365 and custom applications.
Why the score is not higher
Microsoft offers several overlapping paths: the framework, Foundry Agent Service, model providers, hosted agents and Copilot-oriented distribution. That is powerful, but it increases architectural decision load. Pricing also depends on the selected models, hosted compute and tools rather than resolving to one simple agent price.
4. Self-hosted frameworks: best for control
Self-hosting is a category, not one product. It may combine LangGraph, CrewAI, Microsoft Agent Framework or another open framework with Kubernetes, Cloud Run, containers, private inference, external model APIs, custom memory and an observability stack.
The strongest self-hosted architecture can exceed every managed service for data control, customization and portability. The median implementation may be less reliable because its owners must build checkpointing, retry policies, secrets management, isolation, scaling, telemetry and incident response themselves.
Advantages
- Maximum control over infrastructure, models, data and logs.
- Ability to run in private clouds, sovereign environments or on-premises.
- Reduced dependence on a single runtime vendor.
- Freedom to tune orchestration and economics for a narrow workload.
Hidden costs
- Platform engineering and on-call staffing.
- Sandbox and secret-isolation design.
- Version compatibility and framework upgrades.
- Evaluation, tracing and governance integration.
- Capacity planning and recovery testing.
5. Amazon Bedrock Managed Agents: best AWS-native route to OpenAI
Amazon Bedrock Managed Agents is a jointly developed, AWS-native version of OpenAI's Agents API. It runs stateful agents using OpenAI models on Bedrock while integrating with AWS identities, permissions and governance. Developers provide an execution environment, while the service manages the session and agent-model interaction.
This is strategically significant because enterprises can use the Codex harness and OpenAI models within their AWS operating model and apply usage toward existing cloud commitments where applicable.
Why it ranks fifth today
The ranking reflects readiness, not potential. At the evidence cut-off the product was in preview and documentation listed regional preview endpoints in US East and US West locations. Preview status, boundaries and regional availability must be treated as material constraints for production procurement.
Dimension-by-dimension scorecard
| Dimension | Weight | OpenAI | Microsoft | Self-hosted | AWS BMA | |
|---|---|---|---|---|---|---|
| Reliability and state | 20% | 9.3 | 9.3 | 8.8 | 7.5 | 8.2 |
| Security and governance | 15% | 9.3 | 7.8 | 9.4 | 8.4 | 9.0 |
| Tools and protocols | 15% | 9.0 | 9.5 | 8.8 | 9.2 | 8.2 |
| Observability and evals | 10% | 9.2 | 8.2 | 9.2 | 7.4 | 7.7 |
| Deployment and scale | 10% | 9.2 | 9.3 | 9.0 | 7.2 | 7.7 |
| Model portability | 10% | 8.7 | 7.2 | 9.0 | 9.8 | 6.8 |
| Control and residency | 10% | 8.7 | 7.2 | 9.2 | 10.0 | 9.0 |
| Cost clarity | 5% | 8.3 | 8.7 | 7.2 | 6.4 | 6.5 |
| Product maturity | 5% | 9.0 | 7.0 | 8.6 | 8.0 | 5.0 |
How to choose in five questions
- Where must data and execution live? Residency or existing cloud controls can eliminate options before feature comparison begins.
- Who owns reliability? If there is no platform team to operate state, queues, sandboxes and recovery, managed infrastructure deserves a large weight.
- How important is model portability? Do not score a runtime as portable merely because it speaks to external tools. Test whether agent definitions, sessions and policies can move.
- What is the unit of cost? Compare cost per successful business outcome, not token prices alone.
- What evidence survives an incident? Production agents need traces, tool receipts, identities, policy decisions and human override records.
The DN Alpha Thesis
The agent-runtime market is likely to split into three economic layers. Foundation-model companies will sell integrated intelligence and harnesses. Cloud platforms will sell governed execution near enterprise data. Open frameworks will become a portability and bargaining layer across both.
The durable winner may therefore not have the highest raw model score. It may be the runtime that makes agents easiest to audit, recover, authorize and move. As agent work becomes longer and more economically consequential, reliability-adjusted cost will matter more than price per million tokens.
This creates a measurement opportunity for Decentralised News: track cost per verified successful task, not model price. A cheap run that fails, requires human cleanup or triggers the wrong tool is economically expensive.
For vendors and research teams
DN will expand this index with reproducible workload tests. Platforms may provide test credits, technical corrections and documented evidence. Sponsorship will never purchase a score or ranking.
Submit evidenceExplore AgenticFi researchMethodology
DN reviewed official documentation, pricing information, release material and product-status disclosures. Each runtime category received a 0 to 10 score in nine dimensions. Scores were multiplied by the stated default weights and converted to 100 points. Capabilities documented as preview received maturity or availability penalties. Unverified marketing claims and customer testimonials were not counted as independent performance evidence.
The self-hosted score represents a competent production deployment using a modern open framework. It is not a score for every self-hosted implementation. Actual outcomes vary more widely in this category than in the managed categories.
Planned live benchmark: identical multi-step research, coding, document-processing and tool-use workloads; repeated trials; success adjudication; cold and warm latency; recovery after interruption; tool-call accuracy; long-session drift; context-compaction loss; operator minutes; and total cost per successful task.
Primary sources
- OpenAI: Introducing the Agents API
- OpenAI Developers: Agents API overview
- AWS: Bedrock Managed Agents preview announcement
- AWS documentation: Bedrock Managed Agents powered by OpenAI
- Google Cloud: Gemini Enterprise Agent Platform documentation
- Google Cloud: Scaling agents in production
- Microsoft: Agent Framework overview
- Microsoft Foundry: Hosted agents
- CrewAI: Agent Management Platform documentation
- LangChain: LangSmith deployment and data-plane documentation
Frequently asked questions
What is the best managed AI agent runtime in 2027?
Google Vertex AI Agent Engine leads DN's documentation-tested readiness index. OpenAI Agents API is the strongest choice for developer velocity. The right result changes when cloud alignment, model portability or infrastructure control receives more weight.
Is OpenAI Agents API the same as a model API?
No. It provides a managed Codex harness that handles sessions, orchestration, context compaction and recovery around model calls and tools.
Does Amazon Bedrock Managed Agents run OpenAI agents inside AWS?
AWS states that its jointly developed service runs OpenAI-powered stateful agents within AWS and integrates with AWS identity, permissions and governance. It remained a preview service at the evidence cut-off.
Is Microsoft Agent Framework fully managed?
The framework itself is an open-source development framework. Microsoft Foundry Agent Service provides the related hosted runtime and managed production services.
Is self-hosting cheaper?
Not automatically. Infrastructure can be economical at scale, but engineering, security, observability, upgrades and on-call operations must be included. Compare total cost per successful task.
Can these scores prove which runtime is fastest?
No. This edition measures documented production readiness. DN will label live workload results separately after repeatable testing.
Disclosure
This article is independent research and general information, not investment, legal, security or procurement advice. Product capabilities, status, availability and prices can change. Decentralised News may earn revenue from clearly disclosed commercial relationships, but no payment purchases inclusion, methodology changes or ranking position. No unverified affiliate links are used in this edition.






