
Agentic AI Workflows Explained: Patterns, Infrastructure, and GPU Requirements
Agentic workflows plan, loop, and burst differently than a single model call — here's what that means for the infrastructure underneath.
Blog
Runpod now integrates directly with AI IDEs like Cursor and Claude Code using MCP. Launch Pods, deploy endpoints, and manage infrastructure, right from.

The way you build with AI is changing—and now, so is the way you interact with your infrastructure. Runpod ships an official MCP server, unlocking chat-native access to your GPU fleet from any AI-first IDE.
Drop it into Claude Code, Cursor, Codex CLI, VS Code, Windsurf, Cline, Gemini CLI, Claude Desktop, or any JetBrains IDE. If your tool speaks Model Context Protocol (MCP), it now speaks fluent Runpod.
No more context switching. No more hand-written curl commands. Just talk to your editor and your model handles the infrastructure like spinning up Pods, deploying endpoints, manage volumes, and more.
MCP is an open JSON‑RPC 2.0 standard that lets language model interfaces and tool providers speak the same language.
Instead of bolting together fragile glue code and one-off REST wrappers, you just define a few message types (initialize, request, result, etc.) and let the model decide what tools to invoke and when to do it. The MCP server handles the call. The client (Cursor, Claude Code, etc.) handles the UI. Your model handles the logic.
With the Runpod MCP server, that means full access to your Runpod account; directly from your editor, no context switch required.
Runpod actually ships two MCP servers:
@runpod/mcp-server.https://docs.runpod.io/mcp.The rest of this post focuses on the API server. The docs server is covered at the end.
Once the API server is connected, your assistant can reach all of the tools below. You can toggle individual tools on and off in your client, so what the model is allowed to do stays entirely within your control.
Pods
create-podlist-podsstart-podstop-poddelete-podget-podServerless Endpoints
create-endpointlist-endpointget-endpointdelete-endpointupdate-endpointTemplates
list-templateget-templatecreate-templateupdate-templatedelete-templateEndpoint jobs & runtime
run-endpointrunsync-endpointget-job-statusstream-jobcancel-jobretry-jobpurge-endpoint-queueendpoint-healthNetwork Volumes
list-network-volumesget-network-volumecreate-network-volumeupdate-network-volumedelete-network-volumeContainer Registry Auth
list-container-registry-authsget-container-registry-authcreate-container-registry-authdelete-container-registry-authDiscovery (read-only)
list-gpu-typeslist-data-centersUnder the hood, the create/read/update/delete tools wrap the same REST operations you already know, while the read-only discovery tools (list-gpu-types, list-data-centers) use Runpod's public GraphQL API, so they work without write access. Your model fills in the parameters and handles validation and errors for you.
Once set up, you can talk to your AI assistant like this:
“Create a serverless endpoint using my template called jacobs-comfyui.”
Behind the scenes, your IDE routes that natural-language request to your LLM, which selects the right MCP tool (create-endpoint), fills in the parameters, and fires it off to Runpod. A few seconds later, your endpoint is live.
No terminal. No docs. Just code and chat.
You don't have to clone or build anything. The server runs straight from npm:
RUNPOD_API_KEY=YOUR_API_KEY npx @runpod/mcp-server@latestMost clients just need this same command wired into their config. Examples follow.
Replace YOUR_API_KEY with your actual Runpod API key in every example below.
Add the server globally so it's available across all your projects:
claude mcp add runpod -s user \
-e RUNPOD_API_KEY=YOUR_API_KEY \
-- npx -y @runpod/mcp-server@latestOr scope it to a single project (this writes a .mcp.json file you can commit):
claude mcp add runpod -s project \
-e RUNPOD_API_KEY=YOUR_API_KEY \
-- npx -y @runpod/mcp-server@latestVerify with claude mcp list. If you're already in a session, type /mcp to reconnect without restarting.
codex mcp add runpod --env RUNPOD_API_KEY=YOUR_API_KEY -- npx -y @runpod/mcp-server@latestAdd the following to .cursor/mcp.json in your project, or ~/.cursor/mcp.json for global access. This works with both the Cursor IDE and the Cursor Agent:
{
"mcpServers": {
"runpod": {
"command": "npx",
"args": ["-y", "@runpod/mcp-server@latest"],
"env": {
"RUNPOD_API_KEY": "YOUR_API_KEY"
}
}
}
}These clients use the same command / args / env pattern shown above; only the location of the config file differs:
~/.codeium/windsurf/mcp_config.jsoncline_mcp_settings.json (open via the MCP Servers panel in the Cline sidebar).vscode/mcp.json, or run MCP: Add Server → stdio from the Command Palette~/.gemini/settings.json (global) or .gemini/settings.json (project)~/.junie/mcp.json (global) or .junie/mcp/ in your projectOnce connected, you can talk to your assistant in plain language:
"Create a Serverless endpoint from my template 30zmvf89kd, named image-gen, scaling from 0 to 5 workers."
Behind the scenes, your client routes that request to the model, which selects the right tool (create-endpoint), fills in the parameters, and calls Runpod. A few seconds later, your endpoint is live.
A few more things you can just ask for:
"Which secure-cloud GPUs have at least 48 GB of VRAM right now?" → list-gpu-types
"Spin up a single RTX 4090 Pod running the PyTorch image and give me the Pod ID." → create-pod
"Run my endpoint with this input, then stream the job output back to me." → run-endpoint + stream-job
Want your assistant to answer Runpod questions accurately instead of guessing? Add the docs server. It's read-only, needs no API key, and uses HTTP transport.
Claude Code:
claude mcp add runpod-docs --scope user --transport http https://docs.runpod.io/mcpCursor (.cursor/mcp.json):
{
"mcpServers": {
"runpod-docs": {
"url": "https://docs.runpod.io/mcp"
}
}
}Your Runpod API key grants full access to your account. Never share it. Consider creating a separate, limited-permission key for MCP use, be deliberate about which tools you leave enabled, and don't wire this into a production environment without appropriate safeguards.
We’re big believers in developer flow. The future of infrastructure isn’t menus and dashboards. It’s context-aware, assistant-driven, and conversational. By building Runpod’s MCP server, we’re making it feel native to every AI-first editor you already use.
Try it out, and let us know what you'd like us to build next.
Author profile: Jacob Wright
Blog Posts

Agentic workflows plan, loop, and burst differently than a single model call — here's what that means for the infrastructure underneath.

What eleven teams built at the Runpod Flash Hack Day, and the three demos that took home the top prizes.

We tested four models across sixteen workload profiles. Here's exactly what we measured and how.