Tag

Cuda

All articles tagged with #cuda

technology22 days ago•5 min saved

AI Coding Agents Put Nvidia's CUDA Edge to the Test

AI coding agents are increasingly able to reproduce CUDA-like software, threatening Nvidia's long-standing software moat. While startups and cloud providers explore cross-chip compatibility and open approaches, Nvidia argues that its tightly integrated hardware-software stack and robust verification tools still create a durable advantage, suggesting the battle may hinge on how quickly tooling and inference workloads evolve rather than a collapse of CUDA.

via Business Insider|

#ai-coding-agents #chip-software #cuda

technology1 month ago•22 min saved

NVIDIA Opens Windows-on-Arm Gaming Path with RTX Spark CUDA Toolkit Preview

NVIDIA released a first preview of its CUDA toolkit for the RTX Spark platform, enabling native Arm64 optimization on Windows-on-Arm devices. Developers can review Arm64 support, plan porting strategies, and test builds as RTX Spark hardware becomes available (not yet shipping to consumers). Sega has already released AAA titles optimized for RTX Spark, signaling growing ecosystem momentum and future Spark iterations across new CPU/GPU architectures.

via TechPowerUp|

#arm64 #cuda #nvidia

technology1 month ago•4 min saved

CUDA Without Vendor Lock: SCALE lets Nvidia CUDA run on AMD GPUs

Spectral Compute’s SCALE compiler acts as a drop-in replacement for Nvidia’s NVCC, recompiling CUDA code for non-Nvidia GPUs (starting with AMD) so existing CUDA apps run on other hardware without rewrites. The London startup claims CUDA remains the de facto HPC standard and argues its approach preserves accuracy and can outperform HIPIFY-based porting on AMD GPUs, with some benchmarks nearing sixfold gains. Founded in 2018 and about 30 employees, Spectral is expanding toward additional accelerators and CUDA libraries (cuDNN, PyTorch integration) while continuing Nvidia support, and has tested SCALE on Frontier; the company stresses neutrality and collaboration rather than direct competition with Nvidia.

via TechSpot|

#amd #cuda #hpc

technology1 month ago•21 min saved

Cerebras Delivers Breakneck LLM Speed, Yet Nvidia's CUDA Gravity Dominates

NVIDIA just reported a blockbuster data-center quarter powered by CUDA, building a massive software moat, while Cerebras touts wafer-scale speed but braces for negative margins and heavy, CUDA‑centric integration that requires specialized compilation and custom engineering. Despite a $20B+ OpenAI inference deal and benchmarks showing ~21x latency advantage, the lack of broad framework support outside CUDA and the threat of OpenAI’s Jalapeño chip suggest Nvidia’s platform advantage remains hard to dethrone in the near term.

via 24/7 Wall St.|

#ai-inference #cerebras #cuda

technology3 months ago•9 min saved

CUDA Turns Nvidia Into a Software Company, Locking AI Compute

An opinion piece arguing that Nvidia’s real moat isn’t hardware but CUDA—the software platform and libraries that lock AI workloads to Nvidia GPUs—elevating the company to a software powerhouse. CUDA’s ecosystem, PTX-level control, and a large team of software engineers create a practical edge that outperforms rivals like OpenCL, ROCm, and oneAPI in real-world AI work, akin to Apple’s ecosystem moat. While challengers exist (e.g., Modular), CUDA’s software lock-in makes Nvidia’s dominance durable beyond silicon specs.

via WIRED|

#ai #cuda #gpu

technology5 months ago•36 min saved

Nvidia’s Jensen Huang maps a full-stack AI future: GPUs, CPUs, and Groq

Stratechery’s interview with Nvidia CEO Jensen Huang outlines Nvidia’s “accelerated computing” full-stack vision: CUDA, software ecosystems, and AI factories are crucial, with CPUs remaining essential for tool-use and single-thread performance. Huang defends the Groq acquisition for disaggregated inference, discusses Dynamo and open-source models, and weighs China policy, supply chains, and energy constraints as Nvidia seeks to lead across five AI layers rather than rely on a single stack.

via Stratechery by Ben Thompson|

#ai #cuda #groq

technology1 year ago•1 min saved

NVIDIA Expands CUDA Support to RISC-V, Challenging x86 and ARM Dominance

NVIDIA announced that they will bring their CUDA software to RISC-V processors, expanding support beyond x86_64, AArch64, and previously IBM POWER, reflecting the growing interest in RISC-V for data centers. The Linux driver stack is portable, and similar support has been seen with AMD's ROCm on RISC-V and LoongArch processors.

via Phoronix|

#cuda #nvidia #processors

technology2 years ago•2 min saved

"SCALE Toolkit Brings CUDA Support to AMD GPUs"

British startup Spectral Compute has introduced "SCALE," a GPGPU toolchain that enables NVIDIA's CUDA to run directly on AMD GPUs without code porting. This development challenges NVIDIA's software exclusivity by allowing a single codebase to function across multiple hardware platforms. Despite NVIDIA's resistance, SCALE aims to bridge the compatibility gap and has been tested on various applications using AMD's RDNA architectures.

via Wccftech|

#amd #cuda #gpgpu

technology2 years ago•2 min saved

"Nvidia Poised for $10 Trillion Market Cap Amid AI Dominance and Stock Split"

Nvidia's market cap could surge to $10 trillion by 2030, driven by its dominant position in AI chips and software, according to analyst Beth Kindig. The company's hardware, including upcoming Blackwell chips, and its CUDA platform provide a significant competitive edge. Nvidia's role in AI infrastructure and the automotive sector further bolster its growth prospects.

via Yahoo Finance|

#ai #ai-chips #cuda

businesstechnology2 years ago•2 min saved

Nvidia Poised to Rival Apple with $10 Trillion Valuation by 2030

Nvidia's stock is projected to surge 258% and reach a $10 trillion valuation by 2030, driven by its next-generation Blackwell GPU and CUDA software platform, according to I/O Fund tech analyst Beth Kindig. Nvidia's strong market position and "impenetrable moat" around its GPU business are expected to capture a significant share of the AI data center market, outpacing competitors like AMD and Intel.

via Yahoo Finance|

#ai #businesstechnology #cuda

businesstechnology2 years ago•2 min saved

"Nvidia Forecast: 258% Surge to $10 Trillion Valuation"

Nvidia's stock is predicted to surge 258% by 2030, reaching a $10 trillion valuation, driven by its next-generation Blackwell GPU and CUDA software platform. Analyst Beth Kindig highlights Nvidia's strong market position and its significant role in the AI data center market, projecting substantial revenue growth and an "impenetrable moat" around its business.

via Markets Insider|

#ai #businesstechnology #cuda

technology2 years ago•10 min saved

Nvidia Faces Rising Competition in AI Chip Market

Amazon is struggling to compete with Nvidia's dominant AI chips, facing low usage and compatibility issues with its Trainium and Inferentia chips, which threatens AWS's profitability. Despite efforts to innovate and feedback from customers, Nvidia's established CUDA platform remains a significant barrier. Amazon's AI chips have seen limited adoption, and even internal projects often rely on Nvidia GPUs. The company aims to improve its AI chip offerings and work more closely with the open-source community to gain a larger market share.

via Business Insider|

#ai-chips #amazon #aws

technology2 years ago•4 min saved

"NVIDIA and SAP Collaborate to Revolutionize Gen AI Model Deployment with NIM Microservices"

NVIDIA has launched enterprise-grade generative AI microservices that enable businesses to create and deploy custom applications on their own platforms while retaining ownership of their intellectual property. These microservices, built on the NVIDIA CUDA platform, include NIM microservices for optimized inference on popular AI models and CUDA-X microservices for data processing, retrieval-augmented generation, and more. The microservices are adopted by leading application platform providers and can be accessed through NVIDIA AI Enterprise 5.0, offering a standardized path to run custom AI models optimized for NVIDIA's CUDA installed base.

via NVIDIA Blog|

#ai #cuda #generative-ai

technology2 years ago•3 min saved

"Nvidia's Ban on Translation Layers for CUDA Software Targets Chinese GPU Makers and ZLUDA"

Nvidia has updated its licensing terms to ban running CUDA-based software on non-Nvidia hardware using translation layers, potentially targeting initiatives like ZLUDA and Chinese GPU makers. This move aims to protect Nvidia's dominance in the accelerated computing space, particularly with AI applications, but may also impact competition from AMD, Intel, and other developers of AI compute hardware. While recompiling existing CUDA programs remains legal, the ban on translation layers could affect the competitive positioning of other hardware platforms in the GPGPU arena.

via Tom's Hardware|

#chinese-gpu-makers #competition #cuda

technology2 years ago•2 min saved

"AMD's ROCm Enables Unmodified CUDA Code Execution on Radeon GPUs"

ZLUDA, a project funded by AMD, enables unmodified CUDA code to run on AMD Radeon GPUs, allowing native CUDA applications to run on AMD hardware with near-native performance. Despite AMD discontinuing its support for the project, ZLUDA has been released as open-source software. While ZLUDA cannot run Nvidia Optix code, it has shown improved performance over AMD's Radeon HIP code in various applications. The developer plans to continue working on ZLUDA, focusing on personal interests without financial backing from AMD.

via OC3D|

#amd #cuda #gpu