Tag

Gpu Memory

All articles tagged with #gpu memory

technology2 hours ago•6 min saved

4GB VRAM Sparks Memory Bottleneck Debate for New RX 9050 Challenger

ASRock hinted at an AMD RX 9050 Challenger with a 4GB VRAM base option (and an 8GB variant listed elsewhere), a memory configuration seen as a major limitation for modern games. The card is expected to draw 100–125W, and even at low settings it risks stuttering or poor texture detail, making older GPUs like the 1080 Ti more appealing for now. AMD has not officially confirmed the RX 9050 lineup, and the broader AI/datacenter memory demand underpins the concern that 4GB VRAM is insufficient for current titles.

via Boing Boing|

#4gb-vram #amd-rx-9050-challenger #asrock

technology4 months ago•3 min saved

GreenBoost Extends NVIDIA VRAM with System RAM and NVMe for Larger LLMs

An open-source Linux kernel module named GreenBoost adds system RAM and NVMe storage as a CUDA-accessible extension to NVIDIA GPU memory, enabling larger AI models by caching data outside of VRAM. It uses a kernel component to pin memory and export it as DMA-BUF, and a CUDA shim (LD_PRELOAD) to intercept and redirect large allocations to the extended memory pool, while small allocations pass through. The setup is complementary to NVIDIA’s drivers and includes a watchdog to monitor RAM/NVMe pressure; it could allow running models bigger than VRAM (e.g., a 31.8GB model on a 12GB RTX) but requires careful handling of symbol resolution for certain frameworks like Ollama.

via Phoronix|

#gpu-memory #greenboost #linux

technology3 years ago•2 min saved

Windows 11 Runs on GPU Memory for Faster Performance.

Windows modder NTDEV has demonstrated how to create a RAM drive in your GPU's memory and run a virtual machine with Windows 11 or Tiny11, a stripped-down version of Windows 11, on it. The process is surprisingly easy and practical, with solid speeds of 2 GB/s reading and 2.5 GB/s writing, on par with PCIe 3.0 NVMe drives. The concept was demo'd on a laptop equipped with an RTX 3050 with 4 GB of GDDR6, but it should work on GPUs with more than 20 GB of VRAM.

via TechSpot|

#gpu-memory #ntdev #technology