Deploy GPUs on Northflank's managed cloud

You can run GPU workloads on Northflank's managed cloud.

This allows you to use GPU acceleration for your applications and services and only pay for the resources consumed. To deploy GPU workloads on Northflank you must create a GPU-enabled project.

You can deploy combined and deployment services and jobs with GPU access. Northflank GPUs do not currently support timeslicing.

Check the pricing page to find out more about GPU pricing.

To deploy GPU workloads on Northflank's managed cloud, you'll first need to create a new project in a GPU-enabled region.

1. Navigate to the Northflank dashboard and click Create Project
2. Enter a project name
3. Choose Northflank Cloud as the deployment target
4. Select a region with GPU enabled
5. Click Create project

Any services or jobs deployed in this project will have GPU options available in resources. Different regions may have different availability of specific GPU models.

To deploy workloads with GPU access:

1. Navigate to the Services tab in your project dashboard and click Create service
2. Enter a service name and configure your deployment source as described in Build and deploy your code
3. Scroll to the Resources section and click the GPU tab
4. Select an available GPU model from the dropdown (e.g., NVIDIA L4). Each model shows VRAM and hourly pricing
5. Choose the number of GPUs per instance: 1, 2, 4, or 8
6. Review the pricing estimate displayed (billed by the second once provisioned)
7. Configure your Compute plan with appropriate CPU and memory for your workload
8. Set the number of Instances and autoscaling settings
9. Click Create service

Note: GPU deployments require account credit. Ensure you have at least $50 in credit before deploying. Each instance will have access to the GPU count you selected.

You may need to configure your workload to make use of GPU hardware, or multiple GPUs.