Providers & requests

Model provider

Also called: provider

A model provider is the company or service that hosts a model behind an API. Your agent sends requests to it and gets completions back; you never run the model yourself.

James Phoenix
Understanding Data Updated July 2, 2026

Running a frontier model takes a rack of expensive accelerators and a lot of engineering. Almost nobody does it themselves. Instead you use a model provider: a company like Anthropic, OpenAI, or Google that hosts the model and exposes it over an API. Your coding tool sends text to the provider, the provider runs inference on its own hardware, and the result comes back over the wire.

What the provider actually owns

Understanding the split helps you reason about cost, privacy, and reliability:

  • The weights and the hardware. The model file and the machines it runs on live with the provider, not on your laptop.
  • The API contract. The provider defines the request shape, the available models, the rate limits, and the pricing.
  • Uptime and versions. When the provider has an outage or retires a model version, your tool is affected, because your tool is just a client.

Why it matters when you are coding

Your harness is a thin layer sitting on top of somebody else's API. That is freeing and constraining at once. You get state-of-the-art models without owning any infrastructure, but you also inherit their latency, their pricing, and their limits. Every request leaves your machine and is processed on the provider's servers, which is worth remembering before you paste in secrets or proprietary code.

Note
"Model" and "provider" are not the same choice. One provider usually offers several models at different sizes and prices, and many tools let you point the same harness at different providers entirely.

Related terms

Building with AI agents?

This dictionary is part of how I think about agentic engineering. If you want the same thinking applied to your codebase, that is what I do.

See how I can help