Brendan McKeag
July 10, 2023
How to Use 65B+ Language Models on Runpod
Large language models like Guanaco 65B can run on Runpod with the right optimizations. Learn how to handle quantization, memory, and GPU sizing.
AI Infrastructure
All
Blog
The Runpod Blog
Runpod product updates, AI infrastructure guides, GPU tutorials, and deployment patterns for developers building with cloud GPUs.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Brendan McKeag
July 7, 2023
SuperHot 8k Token Context Models Are Here For Text Generation
New 8k context models from TheBloke, like WizardLM, Vicuna, and Manticore, allow longer, more immersive text generation in Oobabooga. With more room for.
All
Justin Merrell
July 1, 2023
Worker | Local API Server Introduced with runpod-python 0.10.0
Starting with runpod-python 0.10.0, you can launch a local API server for testing your worker handler using --rp_serve_api. This feature improves the.
Product Updates
All
Justin Merrell
June 30, 2023
VS Code Server | Local-Quality Development Experience
Use the VS Code Server template on Runpod to connect your local VS Code editor to a GPU-powered development pod, offering a seamless remote dev experience.
Product Updates
All
Justin Merrell
June 30, 2023
VS Code Server on Runpod: Local-Quality Remote Development
Unlock seamless coding with the VS Code Server template on Runpod. Learn how to connect, code, and iterate remotely with local-like speed and responsiveness.
AI Infrastructure
All
River Snow
June 20, 2023
Deploy Python ML Models on Runpod, No Docker Needed
Learn how to deploy Python machine learning models on Runpod without touching Docker. This guide walks you through using virtual environments, network.
Product Updates
All
Brendan McKeag
June 18, 2023
Runpod is Proud to Sponsor the StockDory Chess Engine
Runpod is now an official sponsor of StockDory, a rapidly evolving open-source chess engine that improves faster than Stockfish. StockDory offers deep.
Product Updates
All
We couldn't find anything. Try a different search.
