Tag

Cuda

All articles tagged with #cuda

technology1 month ago•7 min saved

Mac Studio vs DGX Spark: Fast Setup and CUDA-Heavy Depth in Local AI

Two premium local AI workstations are contrasted: Mac Studio (M5 Ultra) wins on quick setup, ease of use, and strong token-generation memory bandwidth (up to 256 GB unified memory); DGX Spark trades setup complexity for far stronger concurrent workloads, large-context handling, and CUDA/TensorRT compatibility across a distributed memory setup. Mac Studio starts at $5,499 and is generally easier and cheaper for workloads under ~128 GB, while DGX Spark (two-node) runs around $9,449 with higher total costs and maintenance. For lightweight, fast deployments, Mac Studio; for CUDA-heavy research and scalable multi-node tasks, DGX Spark. Future hardware updates may shift the balance.

via geeky-gadgets.com|

#cuda #dgx-spark #mac-studio

finance1 month ago•14 min saved

Nvidia's AI surge could push shares to $519 by end-2028, Motley Fool says

The Motley Fool argues that Nvidia could reach about $519 per share by the end of 2028 if it sustains roughly 70% revenue growth into fiscal 2028, maintains a ~64% profit margin, and a forward P/E around 28x, aided by its dominance in AI data centers and the CUDA software moat. While this bull case highlights strong upside from AI adoption, it notes potential margin pressure from memory costs and cautions that outcomes depend on execution, market dynamics, and competitive pressures.

via finance.yahoo.com|

#ai-chips #cuda #data-center

technology2 months ago•5 min saved

AI Coding Agents Put Nvidia's CUDA Edge to the Test

AI coding agents are increasingly able to reproduce CUDA-like software, threatening Nvidia's long-standing software moat. While startups and cloud providers explore cross-chip compatibility and open approaches, Nvidia argues that its tightly integrated hardware-software stack and robust verification tools still create a durable advantage, suggesting the battle may hinge on how quickly tooling and inference workloads evolve rather than a collapse of CUDA.

via Business Insider|

#ai-coding-agents #chip-software #cuda

technology2 months ago•22 min saved

NVIDIA Opens Windows-on-Arm Gaming Path with RTX Spark CUDA Toolkit Preview

NVIDIA released a first preview of its CUDA toolkit for the RTX Spark platform, enabling native Arm64 optimization on Windows-on-Arm devices. Developers can review Arm64 support, plan porting strategies, and test builds as RTX Spark hardware becomes available (not yet shipping to consumers). Sega has already released AAA titles optimized for RTX Spark, signaling growing ecosystem momentum and future Spark iterations across new CPU/GPU architectures.

via TechPowerUp|

#arm64 #cuda #nvidia

technology2 months ago•4 min saved

CUDA Without Vendor Lock: SCALE lets Nvidia CUDA run on AMD GPUs

Spectral Compute’s SCALE compiler acts as a drop-in replacement for Nvidia’s NVCC, recompiling CUDA code for non-Nvidia GPUs (starting with AMD) so existing CUDA apps run on other hardware without rewrites. The London startup claims CUDA remains the de facto HPC standard and argues its approach preserves accuracy and can outperform HIPIFY-based porting on AMD GPUs, with some benchmarks nearing sixfold gains. Founded in 2018 and about 30 employees, Spectral is expanding toward additional accelerators and CUDA libraries (cuDNN, PyTorch integration) while continuing Nvidia support, and has tested SCALE on Frontier; the company stresses neutrality and collaboration rather than direct competition with Nvidia.

via TechSpot|

#amd #cuda #hpc

technology3 months ago•21 min saved

Cerebras Delivers Breakneck LLM Speed, Yet Nvidia's CUDA Gravity Dominates

NVIDIA just reported a blockbuster data-center quarter powered by CUDA, building a massive software moat, while Cerebras touts wafer-scale speed but braces for negative margins and heavy, CUDA‑centric integration that requires specialized compilation and custom engineering. Despite a $20B+ OpenAI inference deal and benchmarks showing ~21x latency advantage, the lack of broad framework support outside CUDA and the threat of OpenAI’s Jalapeño chip suggest Nvidia’s platform advantage remains hard to dethrone in the near term.

via 24/7 Wall St.|

#ai-inference #cerebras #cuda

technology5 months ago•9 min saved

CUDA Turns Nvidia Into a Software Company, Locking AI Compute

An opinion piece arguing that Nvidia’s real moat isn’t hardware but CUDA—the software platform and libraries that lock AI workloads to Nvidia GPUs—elevating the company to a software powerhouse. CUDA’s ecosystem, PTX-level control, and a large team of software engineers create a practical edge that outperforms rivals like OpenCL, ROCm, and oneAPI in real-world AI work, akin to Apple’s ecosystem moat. While challengers exist (e.g., Modular), CUDA’s software lock-in makes Nvidia’s dominance durable beyond silicon specs.

via WIRED|

#ai #cuda #gpu

technology6 months ago•36 min saved

Nvidia’s Jensen Huang maps a full-stack AI future: GPUs, CPUs, and Groq

Stratechery’s interview with Nvidia CEO Jensen Huang outlines Nvidia’s “accelerated computing” full-stack vision: CUDA, software ecosystems, and AI factories are crucial, with CPUs remaining essential for tool-use and single-thread performance. Huang defends the Groq acquisition for disaggregated inference, discusses Dynamo and open-source models, and weighs China policy, supply chains, and energy constraints as Nvidia seeks to lead across five AI layers rather than rely on a single stack.

via Stratechery by Ben Thompson|

#ai #cuda #groq

technology1 year ago•1 min saved

NVIDIA Expands CUDA Support to RISC-V, Challenging x86 and ARM Dominance

NVIDIA announced that they will bring their CUDA software to RISC-V processors, expanding support beyond x86_64, AArch64, and previously IBM POWER, reflecting the growing interest in RISC-V for data centers. The Linux driver stack is portable, and similar support has been seen with AMD's ROCm on RISC-V and LoongArch processors.

via Phoronix|

#cuda #nvidia #processors

technology2 years ago•2 min saved

"SCALE Toolkit Brings CUDA Support to AMD GPUs"

British startup Spectral Compute has introduced "SCALE," a GPGPU toolchain that enables NVIDIA's CUDA to run directly on AMD GPUs without code porting. This development challenges NVIDIA's software exclusivity by allowing a single codebase to function across multiple hardware platforms. Despite NVIDIA's resistance, SCALE aims to bridge the compatibility gap and has been tested on various applications using AMD's RDNA architectures.

via Wccftech|

#amd #cuda #gpgpu

technology2 years ago•2 min saved

"Nvidia Poised for $10 Trillion Market Cap Amid AI Dominance and Stock Split"

Nvidia's market cap could surge to $10 trillion by 2030, driven by its dominant position in AI chips and software, according to analyst Beth Kindig. The company's hardware, including upcoming Blackwell chips, and its CUDA platform provide a significant competitive edge. Nvidia's role in AI infrastructure and the automotive sector further bolster its growth prospects.

via Yahoo Finance|

#ai #ai-chips #cuda

businesstechnology2 years ago•2 min saved

Nvidia Poised to Rival Apple with $10 Trillion Valuation by 2030

Nvidia's stock is projected to surge 258% and reach a $10 trillion valuation by 2030, driven by its next-generation Blackwell GPU and CUDA software platform, according to I/O Fund tech analyst Beth Kindig. Nvidia's strong market position and "impenetrable moat" around its GPU business are expected to capture a significant share of the AI data center market, outpacing competitors like AMD and Intel.

via Yahoo Finance|

#ai #businesstechnology #cuda

businesstechnology2 years ago•2 min saved

"Nvidia Forecast: 258% Surge to $10 Trillion Valuation"

Nvidia's stock is predicted to surge 258% by 2030, reaching a $10 trillion valuation, driven by its next-generation Blackwell GPU and CUDA software platform. Analyst Beth Kindig highlights Nvidia's strong market position and its significant role in the AI data center market, projecting substantial revenue growth and an "impenetrable moat" around its business.

via Markets Insider|

#ai #businesstechnology #cuda

technology2 years ago•10 min saved

Nvidia Faces Rising Competition in AI Chip Market

Amazon is struggling to compete with Nvidia's dominant AI chips, facing low usage and compatibility issues with its Trainium and Inferentia chips, which threatens AWS's profitability. Despite efforts to innovate and feedback from customers, Nvidia's established CUDA platform remains a significant barrier. Amazon's AI chips have seen limited adoption, and even internal projects often rely on Nvidia GPUs. The company aims to improve its AI chip offerings and work more closely with the open-source community to gain a larger market share.

via Business Insider|

#ai-chips #amazon #aws

technology2 years ago•4 min saved

"NVIDIA and SAP Collaborate to Revolutionize Gen AI Model Deployment with NIM Microservices"

NVIDIA has launched enterprise-grade generative AI microservices that enable businesses to create and deploy custom applications on their own platforms while retaining ownership of their intellectual property. These microservices, built on the NVIDIA CUDA platform, include NIM microservices for optimized inference on popular AI models and CUDA-X microservices for data processing, retrieval-augmented generation, and more. The microservices are adopted by leading application platform providers and can be accessed through NVIDIA AI Enterprise 5.0, offering a standardized path to run custom AI models optimized for NVIDIA's CUDA installed base.

via NVIDIA Blog|

#ai #cuda #generative-ai