Llm Model Deployments /

List LLM model deployments

Lists all LLM model deployments for a project

Required permission

Project > AiModels > General > Read

Path parameters

projectId
string required
ID of the project

Query parameters

per_page
integer
The number of results to display per request. Maximum of 100 results per page.
page
integer
The page number to access.
cursor
string
The cursor returned from the previous page of results, used to request the next page.

Response body

{object}
Response object.

data
{object} required
Result data.

llmModelDeployments
[array] required
An array of LLM model deployments in this project.

{object}
An LLM model deployment.

name
string required
The name of the LLM model deployment.
min length
3
max length
100
pattern
^[a-zA-Z0-9]+((-|\s)[a-zA-Z0-9]+)*$
description
string
A description of the LLM model deployment.
max length
1024
pattern
^[\s\S]*$
tags
[array]
An array of previously defined tags to help identify and group the resource.

string
min length
3
max length
100
pattern
^[a-zA-Z0-9]+(-[a-zA-Z0-9]+)*$

spec
{object} required
id
string required
The unique identifier of the LLM model deployment.
projectId
string required
ID of the project that the LLM model deployment belongs to
entityId
string required
The entity ID (team) this deployment belongs to.
entityType
string required
one of
user, team, org
creatorId
string required
The user who created this deployment.
dns
{object} required
DNS configuration for the LLM model deployment.

base
string required
pattern
^([a-zA-Z0-9-]{2,}\.){2,}[a-zA-Z]{2,}$
zone
string required

ports
[array] required
An array of ports for the LLM model deployment.

{object}

id
string required
The id used to identify the port across requests.
pattern
^[a-z]-?[a-z0-9]+(-[a-z0-9]+)*$
name
string required
The name of the port used in the public url and UI.
pattern
^[a-zA-Z](-?[a-zA-Z0-9]+(-[a-zA-Z0-9]+)*)?$
internalPort
integer required
The port number.
protocol
string required
The protocol used by the port.
public
boolean required
If true, the port is exposed publicly.
dns
string
DNS entry for this port.
disableNfDomain
boolean
Disable routing on the default code.run domain for public HTTP ports with custom domains.

status
string required
The current status of the LLM model deployment.
one of
pending, provisioning, starting, crashed, paused, running, deleting
createdAt
string
time of creation
updatedAt
string
time of update

pagination
{object} required
Data about the endpoint pagination.

hasNextPage
boolean required
Is there another page of results available?
cursor
string
The cursor to access the next page of results.
count
number required
The number of results returned by this request.

API

CLI

JS Client

GET /v1/projects/{projectId}/llm-model-deployments

Example response

200 OK

A list of LLM model deployments that belong to the project.

JSON

{
  "data": {
    "llmModelDeployments": [
      {
        "name": "deepseek-v3-deployment",
        "description": "A deployment for DeepSeek V3 model",
        "spec": {
          "configuration": {
            "nodeConfiguration": {
              "storage": {
                "storageClass": "nvme",
                "storageSize": 6144
              }
            }
          }
        },
        "projectId": "default-project"
      }
    ]
  },
  "pagination": {
    "hasNextPage": false,
    "count": 1
  }
}