Brendan McKeagJuly 24, 2023Meta and Microsoft Release Llama 2 as Open SourceLlama 2 is now open source, offering a native 4k context window and strong performance. This post walks through how to download it from Meta or use.All
Brendan McKeagJuly 22, 2023Runpod Roundup: High-Context LLMs, SDXL, and Llama 2This Runpod Roundup covers the arrival of 8k-16k token context models, the release of Stable Diffusion XL, and the launch of Llama 2 by Meta and.All
Brendan McKeagJuly 20, 2023How to Install SillyTavern in a Runpod InstanceWant to upgrade from basic chat UIs? SillyTavern offers a more interactive interface for AI conversations. Here’s how to install it on your own Runpod instance.Learn AIAll
Brendan McKeagJuly 19, 202316k Context LLM Models Now Available On RunpodRunpod now supports Panchovix's 16k-token context models, allowing for much deeper context retention in long-form generation. These models require higher.Product UpdatesAll
Brendan McKeagJuly 18, 2023Runpod Partners With Defined.ai To Democratize and Accelerate AI DevelopmentRunpod announces a partnership with Defined.ai to offer ethically sourced speech and text datasets to AI developers, starting with a pilot program to.Product UpdatesAll
Brendan McKeagJuly 10, 2023How to Use 65B+ Language Models on RunpodLarge language models like Guanaco 65B can run on Runpod with the right optimizations. Learn how to handle quantization, memory, and GPU sizing.AI InfrastructureAll
Brendan McKeagJuly 7, 2023SuperHot 8k Token Context Models Are Here For Text GenerationNew 8k context models from TheBloke, like WizardLM, Vicuna, and Manticore, allow longer, more immersive text generation in Oobabooga. With more room for.All