
What You'll Need to Run Falcon 180B In a Pod
Falcon-180B is the largest open-source LLM to date, requiring 400GB of VRAM to run unquantized. This post explores how to deploy it on Runpod with A100s.
Blog
Runpod product updates, AI infrastructure guides, GPU tutorials, and deployment patterns for developers building with cloud GPUs.


Falcon-180B is the largest open-source LLM to date, requiring 400GB of VRAM to run unquantized. This post explores how to deploy it on Runpod with A100s.

Reflections on generating conversational German audio with LLMs and Bark, highlighting common pitfalls in parsing, generation reliability, and the.

his week's roundup covers Alibaba's vision-language model Qwen-VL, Meta's new code-focused LLM Code Llama, and FACET, a benchmark for detecting bias in.

Bench, Neuralangelo, and Marqo highlight this week's updates, open-source tools for evaluating LLMs, reconstructing 3D scenes, and enabling GPU-powered.

A simple guide to training custom video LoRAs using Diffusion-Pipe on Runpod, perfect for creators and AI enthusiasts.

Learn how to set up Stable Diffusion with ComfyUI on Runpod for fast, flexible AI image generation.

Learn how rank, learning rate, and training epochs impact the output of textual LoRAs, and how to balance these settings for coherent, stylistically.
