Modal

Type: full-code · Vendor: Modal Labs · Language: Python · License: Apache-2.0 · Status: active · Status in practice: mature · First released: 2022

Links: homepage docs repo

Serverless compute platform that turns Python functions into autoscaled cloud containers and exposes Sandboxes as ephemeral, secure runtimes for executing AI-generated code on demand.

Description. Modal is an AI infrastructure platform built by Modal Labs. Developers decorate Python functions with `@app.function` (optionally with a GPU, image, schedule, or `modal.Sandbox` reference) and Modal containerises and runs them in the cloud with sub-second cold starts and autoscaling. For agentic workloads the headline primitive is the Sandbox: a constructor (`Sandbox.create`) that programmatically spins up isolated containers to run untrusted or LLM-generated code, with filesystem, directory, and memory snapshots to checkpoint and restore state.

Agent loop shape. Modal is not itself an agent runtime; it is the substrate. Agent frameworks call `Sandbox.create()` to obtain an ephemeral container, send code or shell commands into it, observe stdout/stderr/files, optionally snapshot the filesystem or memory, and either reuse, detach, or terminate the Sandbox. Scheduled functions use the `schedule=modal.Period(...)` or `modal.Cron(...)` parameter on `@app.function` so the entry-point runs on a cadence without external orchestration.

Primary use cases

secure sandboxed execution of LLM-generated code
GPU-backed inference and fine-tuning
scheduled / cron-driven serverless jobs
containerised batch compute for agents

flowchart TD user[Developer code] --> app[modal.App] app --> fn[@app.function] fn -->|schedule=Period/Cron| cron[Recurring run] fn -->|invoked| run[Containerised execution] fn -->|creates| sb[Sandbox.create] sb --> iso[Isolated container] iso --> exec[Run LLM-generated code / shell] exec --> snap{Snapshot?} snap -->|filesystem| fs[Filesystem snapshot] snap -->|memory| mem[Memory snapshot] snap -->|directory| dir[Directory snapshot] snap -->|no| detach[detach / terminate] fs --> restore[Restore later] mem --> restore dir --> restore

Key concepts

App (docs) — Container for a set of related Modal Functions: `app = modal.App("name")`.
Function (docs) — Python function decorated with `@app.function(...)`; Modal builds an image and runs it in the cloud.
Sandbox → sandbox-isolation (docs) — Ephemeral isolated container created at runtime via `Sandbox.create` for executing untrusted/agent code.
Sandbox snapshots → agent-resumption (docs) — Filesystem, directory, and memory snapshots that save and restore Sandbox state.
Schedule (Period / Cron) → scheduled-agent (docs) — `schedule=modal.Period(...)` or `modal.Cron(...)` on `@app.function` runs the function on a cadence.