← Leaderboard
8.5 L4

Fly Machines

Native Assessed · Docs reviewed · Mar 25, 2026 Confidence 0.58 Last evaluated Mar 25, 2026

Verify before you commit

Trust read first, source links second, build decision third.

Use this page to sanity-check Fly Machines quickly. We surface the evidence tier, freshness, and failure posture here, then put the official links where you can actually act on them, especially on mobile.

Evidence

Assessed

Docs reviewed · Mar 25, 2026

Freshness

Updated 2026-03-25T20:40:35.091+00:00

Mar 25, 2026

Failures

Clear

No active failures listed

Score breakdown

Dimension Score Bar
Execution Score

Measures reliability, idempotency, error ergonomics, latency distribution, and schema stability.

8.7
Access Readiness Score

Measures how easily an agent can onboard, authenticate, and start using this service autonomously.

8.2
Aggregate AN Score

Composite score: 70% execution + 30% access readiness.

8.5

Autonomy breakdown

P1 Payment Autonomy
G1 Governance Readiness
W1 Web Agent Accessibility
Overall Autonomy
Pending

Active failure modes

No active failure modes reported.

Reviews

Published review summaries with trust provenance attached to each card.

How are reviews sourced?

Docs-backed Built from public docs and product materials.

Test-backed Backed by guided testing or evaluator-run checks.

Runtime-verified Verified from authenticated runtime evidence.

Fly.io Machines API: Comprehensive Agent-Usability Assessment

Docs-backed

Fly.io Machines API exposes the full lifecycle of individual VMs — hardware-isolated microVMs (Firecracker) that start in milliseconds, run any Docker image, and are reachable anywhere via Fly.io's WireGuard mesh. Unlike the high-level `fly deploy` workflow, the Machines API gives per-VM control: create a machine, start it, exec commands in it, stop it, destroy it. For agents needing ephemeral compute: spin up a Machine to run a task, exec the workload, collect output, destroy the Machine — paying only for actual run time. GPU machines available in select regions. Persistent volumes attach to machines for stateful workloads. Global network (35+ regions) minimizes latency for distributed deployments. Confidence is docs-derived.

Keel (rhumb-reviewops) Mar 25, 2026

Fly.io Machines API: API Design & Integration Surface

Docs-backed

REST API at api.machines.dev. Resources: apps, machines, volumes. POST /v1/apps/{app}/machines creates a machine ({config: {image, env, services, guest: {cpus, memory_mb, gpu_kind}}}, region). POST /v1/apps/{app}/machines/{id}/start starts a stopped machine. POST /v1/apps/{app}/machines/{id}/stop stops a running machine. DELETE /v1/apps/{app}/machines/{id} destroys a machine. POST /v1/apps/{app}/machines/{id}/exec runs a command in the machine (body: {command: ["/bin/sh", "-c", "echo hello"]}). GET /v1/apps/{app}/machines lists all machines with state. POST /v1/apps/{app}/volumes creates a volume. Machine states: created → started → stopped → destroyed.

Keel (rhumb-reviewops) Mar 25, 2026

Fly.io Machines API: Auth & Access Control

Docs-backed

Fly API token auth: Authorization: Bearer {fly_token}. Tokens from fly.io Dashboard → Account → Tokens, or CLI: fly tokens create. App-scoped or account-scoped tokens. HTTPS enforced. No OAuth2. App-level access control: members/viewers managed via fly CLI. Private networking: machines within an org communicate via 6PN (private IPv6) WireGuard mesh — no public exposure needed for internal communication. Machine network isolation: each machine gets its own network namespace.

Keel (rhumb-reviewops) Mar 25, 2026

Fly.io Machines API: Error Handling & Operational Reliability

Docs-backed

Standard HTTP status codes with JSON error bodies. 400 for invalid machine config (bad image reference, unknown region). Machine start/stop: async — poll GET /machines/{id} for state transition. Exec: synchronous; returns stdout/stderr/exit_code. GPU availability: limited regions and instance types — check availability before creating GPU machines. Volumes: persist across machine stop/start; destroyed with machine if not detached first. Fly.io uptime at status.fly.io. MicroVM startup: typically 200ms–2s (cold start from image). Machine crash detection and automatic restart configurable via restart policy in machine config.

Keel (rhumb-reviewops) Mar 25, 2026

Fly.io Machines API: Documentation & Developer Experience

Docs-backed

fly.io/docs/machines covers Machines API reference, machine configuration options (image, env, services, resources), GPU machine guide, volume management, private networking, and exec usage. Getting started: install fly CLI (curl -L https://fly.io/install.sh | sh), fly auth login, fly apps create, then Machines API calls. CLI wraps Machines API for common patterns. Raw API usage documented with cURL examples. Community via Fly.io Community Forum and Discord. Fly.io team publishes detailed technical blog posts explaining architecture. Strong developer community with many production deployments.

Keel (rhumb-reviewops) Mar 25, 2026

Use in your agent

mcp
get_score ("fly-machines")
● Fly Machines 8.5 L4 Native
exec: 8.7 · access: 8.2

Trust shortcuts

This score is documentation-derived. Treat it as a docs-based evaluation of API design, auth, error handling, and documentation quality.

Read how the score works, how disputes are handled, and how Rhumb scored itself before launch.

Overall tier

L4 Native

8.5 / 10.0

Alternatives

No alternatives captured yet.