Quickstart

Currently in private preview. Sign up at console.modular.com/signup to request access.

This guide walks you through signing up, creating an API key, and sending your first request. Sign up for private preview access at console.modular.com/signup.

Create an API key

Go to the API Tokens page in the console and create a new token. Copy it now. You won’t be able to see it again after closing the dialog. Export your key as an environment variable:

export MODULAR_API_KEY="your_api_key_here"

Send a request

Use the OpenAI SDK or curl to make your first inference call:

Python
curl

Install the OpenAI SDK:

pip install openai

Send a chat completion request:

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.modular.com/v1",
    api_key=os.environ["MODULAR_API_KEY"],
)

response = client.chat.completions.create(
    model="google/gemma-4-31B-it",
    messages=[{"role": "user", "content": "Hello, how are you?"}],
)

print(response.choices[0].message.content)

I'm doing well, thank you for asking! How can I assist you today?

Send a chat completion request using curl:

curl -X POST https://api.modular.com/v1/chat/completions \
  -H "Authorization: Bearer $MODULAR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "google/gemma-4-31B-it",
    "messages": [{"role": "user", "content": "Hello, how are you?"}]
  }'

{
  "choices": [
    {
      "finish_reason": "stop",
      "index": 0,
      "message": {
        "content": "I'm doing well, thank you for asking! How can I assist you today?",
        "role": "assistant"
      }
    }
  ],
  "model": "google/gemma-4-31B-it",
  "object": "chat.completion"
}

Already using the OpenAI SDK? Just change base_url to https://api.modular.com/v1 and set api_key to your API key. No other code changes required.

Explore the playground

Try models interactively in the console playground without writing any code. The playground lets you compare models, adjust parameters, and experiment with prompts before integrating into your application.

Next steps

Text inference: text-to-text, image-to-text, and video-to-text
Image inference: generate and transform images with FLUX
Video inference: generate video from text with Wan
Models: browse all available models

Inference

Deployments

Administration

Create an API key

Send a request

Explore the playground

Next steps

​Sign up

​Create an API key

​Send a request

​Explore the playground

​Next steps

Sign up

Create an API key

Send a request

Explore the playground

Next steps