Tag

Mi300x

All articles tagged with #mi300x

technology2 years ago•3 min saved

AMD's MI300X GPU Outperforms NVIDIA's H100 TensorRT-LLM in Optimized AI Software Stack

AMD has responded to NVIDIA's H100 TensorRT-LLM benchmarks by showcasing that its Instinct MI300X GPU still outperforms the H100, even when the H100 is running optimized software. AMD claims that the benchmarks used by NVIDIA were not using the optimized libraries and compared different data types, resulting in a skewed comparison. With the latest figures, the MI300X running on vLLM offers 30% faster performance than the H100 running on TensorRT-LLM. The competition between AMD and NVIDIA in the AI space is expected to continue as both companies strive to innovate and excel in offering better capabilities and faster performance.

via Wccftech|

#ai #amd #h100

technology3 years ago•2 min saved

AMD Introduces AI 'Superchip' to Compete with Nvidia's Dominance.

AMD has launched its MI300X AI Accelerator chip, which is designed to challenge NVIDIA's H100 and disrupt its dominance in the AI accelerator market. The chip is tailored for AI tasks and has up to 192GB of memory, making it ideal for executing large models like LLMs. The underlying architecture of the chip has been engineered to support generative AI workloads smoothly. AMD's MI300X AI Accelerator is a force to be reckoned with, and the world will be watching to see if this underdog can hit a home run.

via Decrypt|

#ai #amd #llms

technology3 years ago•2 min saved

AMD unveils AI chip to compete with Nvidia.

AMD has announced that it will start shipping its most advanced GPU for artificial intelligence, the MI300X, to some customers later this year. The move represents a challenge to Nvidia, which currently dominates the market for AI chips with over 80% market share. AMD's AI chips, which it calls "accelerators," could represent a big untapped market for the chipmaker, which is best known for its traditional computer processors. The MI300X can use up to 192GB of memory, which means it can fit even bigger AI models than other chips. AMD also said it would offer an Infinity Architecture that combines eight of its M1300X accelerators in one system.

via CNBC|

#ai-chips #amd #lisa-su