Marut Pandya
September 10, 2024
Boost vLLM Performance on Runpod with GuideLLM
Learn how to use GuideLLM to simulate real-world inference loads, fine-tune performance, and optimize cost for vLLM deployments on Runpod.
AI Workloads
All
Marut Pandya
Marut Pandya
July 1, 2024
AMD MI300X vs. Nvidia H100 SXM: Performance Comparison on Mixtral 8x7B Inference
Runpod benchmarks AMD's MI300X against Nvidia's H100 SXM using Mistral's Mixtral 8x7B model. The results highlight performance and cost trade-offs across.
All
Marut Pandya
July 1, 2024
AMD MI300X vs. NVIDIA H100: Mixtral 8x7B Inference Benchmark
We benchmarked AMD’s MI300X against NVIDIA’s H100 on Mixtral 8x7B. Discover which GPU delivers faster inference and better performance-per-dollar.
All
We couldn't find anything. Try a different search.
