Tag

Cuda

All articles tagged with #cuda

technology13 days ago•21 min saved

Cerebras Delivers Breakneck LLM Speed, Yet Nvidia's CUDA Gravity Dominates

NVIDIA just reported a blockbuster data-center quarter powered by CUDA, building a massive software moat, while Cerebras touts wafer-scale speed but braces for negative margins and heavy, CUDA‑centric integration that requires specialized compilation and custom engineering. Despite a $20B+ OpenAI inference deal and benchmarks showing ~21x latency advantage, the lack of broad framework support outside CUDA and the threat of OpenAI’s Jalapeño chip suggest Nvidia’s platform advantage remains hard to dethrone in the near term.

via 24/7 Wall St.|

#ai-inference #cerebras #cuda

technology2 months ago•9 min saved

CUDA Turns Nvidia Into a Software Company, Locking AI Compute

An opinion piece arguing that Nvidia’s real moat isn’t hardware but CUDA—the software platform and libraries that lock AI workloads to Nvidia GPUs—elevating the company to a software powerhouse. CUDA’s ecosystem, PTX-level control, and a large team of software engineers create a practical edge that outperforms rivals like OpenCL, ROCm, and oneAPI in real-world AI work, akin to Apple’s ecosystem moat. While challengers exist (e.g., Modular), CUDA’s software lock-in makes Nvidia’s dominance durable beyond silicon specs.

via WIRED|

#ai #cuda #gpu

technology3 months ago•36 min saved

Nvidia’s Jensen Huang maps a full-stack AI future: GPUs, CPUs, and Groq

Stratechery’s interview with Nvidia CEO Jensen Huang outlines Nvidia’s “accelerated computing” full-stack vision: CUDA, software ecosystems, and AI factories are crucial, with CPUs remaining essential for tool-use and single-thread performance. Huang defends the Groq acquisition for disaggregated inference, discusses Dynamo and open-source models, and weighs China policy, supply chains, and energy constraints as Nvidia seeks to lead across five AI layers rather than rely on a single stack.

via Stratechery by Ben Thompson|

#ai #cuda #groq

technology11 months ago•1 min saved

NVIDIA Expands CUDA Support to RISC-V, Challenging x86 and ARM Dominance

NVIDIA announced that they will bring their CUDA software to RISC-V processors, expanding support beyond x86_64, AArch64, and previously IBM POWER, reflecting the growing interest in RISC-V for data centers. The Linux driver stack is portable, and similar support has been seen with AMD's ROCm on RISC-V and LoongArch processors.

via Phoronix|

#cuda #nvidia #processors

technology2 years ago•2 min saved

"SCALE Toolkit Brings CUDA Support to AMD GPUs"

British startup Spectral Compute has introduced "SCALE," a GPGPU toolchain that enables NVIDIA's CUDA to run directly on AMD GPUs without code porting. This development challenges NVIDIA's software exclusivity by allowing a single codebase to function across multiple hardware platforms. Despite NVIDIA's resistance, SCALE aims to bridge the compatibility gap and has been tested on various applications using AMD's RDNA architectures.

via Wccftech|

#amd #cuda #gpgpu

technology2 years ago•2 min saved

"Nvidia Poised for $10 Trillion Market Cap Amid AI Dominance and Stock Split"

Nvidia's market cap could surge to $10 trillion by 2030, driven by its dominant position in AI chips and software, according to analyst Beth Kindig. The company's hardware, including upcoming Blackwell chips, and its CUDA platform provide a significant competitive edge. Nvidia's role in AI infrastructure and the automotive sector further bolster its growth prospects.

via Yahoo Finance|

#ai #ai-chips #cuda

businesstechnology2 years ago•2 min saved

Nvidia Poised to Rival Apple with $10 Trillion Valuation by 2030

Nvidia's stock is projected to surge 258% and reach a $10 trillion valuation by 2030, driven by its next-generation Blackwell GPU and CUDA software platform, according to I/O Fund tech analyst Beth Kindig. Nvidia's strong market position and "impenetrable moat" around its GPU business are expected to capture a significant share of the AI data center market, outpacing competitors like AMD and Intel.

via Yahoo Finance|

#ai #businesstechnology #cuda

businesstechnology2 years ago•2 min saved

"Nvidia Forecast: 258% Surge to $10 Trillion Valuation"

Nvidia's stock is predicted to surge 258% by 2030, reaching a $10 trillion valuation, driven by its next-generation Blackwell GPU and CUDA software platform. Analyst Beth Kindig highlights Nvidia's strong market position and its significant role in the AI data center market, projecting substantial revenue growth and an "impenetrable moat" around its business.

via Markets Insider|

#ai #businesstechnology #cuda

technology2 years ago•10 min saved

Nvidia Faces Rising Competition in AI Chip Market

Amazon is struggling to compete with Nvidia's dominant AI chips, facing low usage and compatibility issues with its Trainium and Inferentia chips, which threatens AWS's profitability. Despite efforts to innovate and feedback from customers, Nvidia's established CUDA platform remains a significant barrier. Amazon's AI chips have seen limited adoption, and even internal projects often rely on Nvidia GPUs. The company aims to improve its AI chip offerings and work more closely with the open-source community to gain a larger market share.

via Business Insider|

#ai-chips #amazon #aws

technology2 years ago•4 min saved

"NVIDIA and SAP Collaborate to Revolutionize Gen AI Model Deployment with NIM Microservices"

NVIDIA has launched enterprise-grade generative AI microservices that enable businesses to create and deploy custom applications on their own platforms while retaining ownership of their intellectual property. These microservices, built on the NVIDIA CUDA platform, include NIM microservices for optimized inference on popular AI models and CUDA-X microservices for data processing, retrieval-augmented generation, and more. The microservices are adopted by leading application platform providers and can be accessed through NVIDIA AI Enterprise 5.0, offering a standardized path to run custom AI models optimized for NVIDIA's CUDA installed base.

via NVIDIA Blog|

#ai #cuda #generative-ai

technology2 years ago•3 min saved

"Nvidia's Ban on Translation Layers for CUDA Software Targets Chinese GPU Makers and ZLUDA"

Nvidia has updated its licensing terms to ban running CUDA-based software on non-Nvidia hardware using translation layers, potentially targeting initiatives like ZLUDA and Chinese GPU makers. This move aims to protect Nvidia's dominance in the accelerated computing space, particularly with AI applications, but may also impact competition from AMD, Intel, and other developers of AI compute hardware. While recompiling existing CUDA programs remains legal, the ban on translation layers could affect the competitive positioning of other hardware platforms in the GPGPU arena.

via Tom's Hardware|

#chinese-gpu-makers #competition #cuda

technology2 years ago•2 min saved

"AMD's ROCm Enables Unmodified CUDA Code Execution on Radeon GPUs"

ZLUDA, a project funded by AMD, enables unmodified CUDA code to run on AMD Radeon GPUs, allowing native CUDA applications to run on AMD hardware with near-native performance. Despite AMD discontinuing its support for the project, ZLUDA has been released as open-source software. While ZLUDA cannot run Nvidia Optix code, it has shown improved performance over AMD's Radeon HIP code in various applications. The developer plans to continue working on ZLUDA, focusing on personal interests without financial backing from AMD.

via OC3D|

#amd #cuda #gpu

technology2 years ago•2 min saved

"AMD GPUs Now Support Unmodified NVIDIA CUDA Apps with ROCm and ZLUDA"

AMD's ROCm now indirectly supports NVIDIA CUDA libraries through the open-source ZLUDA project, allowing AMD GPU owners to run CUDA apps within ROCm without code adaptation. ZLUDA, originally designed for NVIDIA CUDA support on Intel GPUs, has been successfully tested with AMD's Radeon GPUs on ROCm, enabling performance on par with NVIDIA for rendering tasks. While native CUDA support on Radeon GPUs remains unavailable, the potential of ZLUDA in bridging ROCm and CUDA stacks for AI applications is promising, with the developer exploring NVIDIA's upscaling capabilities on RDNA GPUs.

via Wccftech|

#amd #cuda #nvidia

technology2 years ago•3 min saved

"AMD's Open-Source CUDA Implementation Funded Quietly"

AMD quietly funded a project to create a drop-in replacement for CUDA on AMD GPUs, allowing many CUDA applications to run on the ROCm stack without modification. The project, based on the ZLUDA implementation, was developed by Andrzej Janik and is now open-source, dual-licensed under Apache 2.0 or MIT. While it's a promising solution, it's not without limitations, such as incomplete NVIDIA OptiX support. The implementation, leveraging the Rust programming language, has been tested successfully, and the exposed device name for Radeon GPUs via CUDA will be updated as part of the open-sourcing.

via Phoronix|

#amd #cuda #open-source

technology2 years ago•4 min saved

"Intel CEO Aims to Dethrone NVIDIA's CUDA Dominance, Open to Rival Chip Manufacturing"

Intel's CEO, Pat Gelsinger, stated that the entire industry is motivated to eliminate NVIDIA's CUDA dominance in the AI market. Intel believes that the future of AI lies in inference rather than training models and aims to prioritize inference developments. Gelsinger sees NVIDIA's success as a temporary "bubble" and believes that the industry will adopt new training methods to bring a broader set of technologies. Intel praised its OpenVINO model and aims to transition towards next-gen markets. However, Intel needs to do more work to challenge CUDA's dominance, and for now, NVIDIA remains the leader in the AI segment.

via Wccftech|

#ai #cuda #inference