Deploy DeepSeek R1-70B on AWS on Northflank

DeepSeek is a groundbreaking LLM which achieves a significant breakthrough in inference speed over previous models.

It tops the leaderboard among open-source models and rivals the most advanced closed-source models globally.

This stack template creates a new cluster in your own Amazon Web Services account, and deploys Ollama and Open WebUI to run and query the DeepSeek R1:70B model in your own cloud account.

This template will deploy:

• 1 AWS cluster in the us-east-1 region with:
  • 1 node pool of 3x t3.xlarge nodes
  • 1 node pool of 1x g6e.8xlarge nodes with 1 x NVIDIA L40S GPU
• A DeepSeek project with:
  • 1 Ollama deployment with a persistent volume
  • 1 Open WebUI deployment with a persistent volume

1. Create an account on Northflank
2. Integrate your AWS account
3. Click deploy Deploy DeepSeek on GCP now
4. Select your AWS account integration
5. Click deploy stack to save and run the DeepSeek template
6. When the template run finishes, view the open-webui service
7. Open the code.run domain and create a user account
8. Select the DeepSeek model and begin using your AI deployment!