Llm Model Deployments /
Create LLM model deployment
Create an LLM model deployment
Required permission
Project > AiModels > General > Create
Path parameters
projectId
string requiredID of the project
Request body
- {object}
name
string requiredThe name of the LLM model deployment.min length3max length100pattern^[a-zA-Z0-9]+((-|\s)[a-zA-Z0-9]+)*$description
stringA description of the LLM model deployment.max length1024pattern^[\s\S]*$ports
[array]- {object}
name
string requiredThe name used to identify the port.min length1max length8pattern^[a-zA-Z](-?[a-zA-Z0-9]+(-[a-zA-Z0-9]+)*)?$internalPort
integer requiredThe port number.min1max65535public
booleanIf true, the port will be exposed publicly.domains
[array]An array of domains to redirect to this port. Each domain must first be verified and registered to your account.- stringA domain to redirect to this port.
disableNfDomain
booleanDisable routing on the default code.run domain for public HTTP ports with custom domains.protocol
string requiredThe protocol to use for the port.one ofHTTP, HTTP/2, TCP, UDPspec
{object} required
API
CLI
JS Client
POST /v1/projects/{projectId}/llm-model-deployments
Example request
Request body
curl
curl --header "Content-Type: application/json" \
--header "Authorization: Bearer NORTHFLANK_API_TOKEN" \
--request POST \
--data '{"name":"deepseek-v3-deployment","description":"A deployment for DeepSeek V3 model","spec":{"configuration":{"nodeConfiguration":{"storage":{"storageClass":"nvme","storageSize":6144}}}}}' \
https://api.northflank.com/v1/projects/{projectId}/llm-model-deploymentsExample response
200 OK
success