
Building Runpod templates: Your first custom template
Build a custom Docker image with PyTorch and a short GPU-check script, push it to Docker Hub, and save it as a private Runpod Pod template so every new Pod starts with your setup in place.
Blog
Run MoonshotAI's Kimi-K2-Instruct on Runpod Clusters using H200 SXM GPUs and a 2TB shared network volume for seamless multi-node training. This guide.

1. Create Network Storage (2TB), Use the CA-MTL-4 region (recommended for now).
2. Spin Up a Pod using Runpod official Pytorch template and mount the network volume you just created, once the pod is running, connect to Jupyter Lab
3. Download the Model
4. Launch the Cluster
1. installation on Node 0 with a shared volume
2. Node 1 Instructions
3. You should see the following:
4. Run on node with ip as host.


Known IssuesCurrently as of July 21st, vllm library is not up to date so need to build from nightly builds.
https://github.com/MoonshotAI/Kimi-K2/issues/19
uv environment on a Network Volume is slow to initialize ray, recommend any python environments be ran on the machine itself instead of on the Network Volume.
Author profile: Brendan McKeag
Blog Posts