Modal

Modal is a serverless cloud platform designed to run compute-intensive code — particularly AI/ML workloads — without managing infrastructure. What makes Modal distinctive is its developer experience: you write Python functions, decorate them with Modal decorators, and they run in the cloud on GPUs, CPU clusters, or any hardware configuration you specify, with zero Docker files, Kubernetes configs, or deployment scripts.

The core abstraction is the Modal Function. You define a Python function, specify its environment (packages, system dependencies, GPU type, memory) via decorators or a configuration object, and Modal handles provisioning the container, scheduling the execution, and returning results. Cold starts are remarkably fast (often under a second) because Modal uses a custom container runtime with snapshot-based image builds — your environment is pre-warmed and ready to go.

For AI agent builders, Modal solves several critical problems. First, it provides on-demand GPU access (A10G, A100, H100) without reservations or commitments — you pay per second of actual compute. This is ideal for agents that need to run ML inference, fine-tune models, or process large datasets as part of their execution flow. Second, Modal's web endpoint feature lets you deploy any Python function as an API endpoint instantly, making it easy to create tool APIs that agents can call.

Modal's container image system is a standout feature. Instead of writing Dockerfiles, you build images programmatically in Python using a fluent API: Image.debianslim().pipinstall("torch", "transformers").apt_install("ffmpeg"). Images are built layer-by-layer with aggressive caching, and the layers are stored in Modal's registry for instant reuse. This makes environment management dramatically simpler than traditional Docker workflows.

The platform supports scheduled functions (cron jobs), persistent volumes for data storage across invocations, secret management, and distributed computing primitives like map/reduce across thousands of containers. Modal also offers web apps via ASGI/WSGI support, so you can deploy FastAPI or Flask applications alongside your compute functions.

Pricing is per-second billing for actual compute time with no minimum charges. GPU pricing is competitive with major cloud providers and significantly cheaper than reserved instances for bursty workloads. The free tier provides $30/month in compute credits.

Limitations include Python-only support (no other languages), no support for long-running stateful processes (functions have a maximum timeout), and vendor lock-in to Modal's proprietary runtime. However, for teams that need elastic GPU compute with minimal ops overhead, Modal represents a significant productivity improvement over managing cloud infrastructure directly.