THE APEX TIMES
NVIDIA pushes NVLink Fusion deeper into custom AI hardware with NVHBM high-bandwidth memory
The company says a new NVLink Fusion option, NVHBM, moves the memory controller into the HBM stack to boost bandwidth and reduce power, while making it easier for hyperscalers to qualify semi-custom AI chips.
NVIDIA said it is expanding NVIDIA NVLink Fusion, a platform aimed at helping large customers and AI chip innovators build semi-custom rack-scale systems without starting from scratch on every hardware component. The new emphasis is memory: the company introduced NVHBM, a next-generation high-bandwidth memory technology designed to increase performance and efficiency for AI processing units (XPUs).
In NVIDIA’s view, today’s AI infrastructure bottlenecks are not only about raw compute. As AI workloads grow in complexity, NVIDIA argues that system performance increasingly depends on how compute, memory, storage, networking, and software are designed together. NVLink Fusion is intended to package that integration work behind a common interconnect and system approach, letting partners focus on their own XPU innovation while relying on NVIDIA’s scale-up and scale-out networking, rack-scale systems, and software building blocks.
The company’s new NVHBM approach is built around a change in where the memory controller sits. In traditional HBM architectures, NVIDIA says the memory controller is placed on the XPU die, taking up valuable silicon area that could otherwise be used for additional compute logic. With NVHBM, NVIDIA moves the custom memory controller into the 3D HBM stack itself, rather than keeping it on the XPU.
NVIDIA linked that design shift to tangible performance and efficiency outcomes. The company said NVHBM delivers up to 30% greater memory bandwidth and 15% lower HBM power consumption. It also said the architecture frees up as much as 25% more area on the XPU compute die compared with “standard HBM4E,” a reference point for a commonly discussed HBM generation in the industry.
Beyond the performance claims, NVIDIA presented NVHBM as a standard implementation. The company said it is establishing NVHBM as a widely deployable configuration that is available from multiple memory providers. NVIDIA argued this can reduce the engineering burden required for partners to integrate and qualify custom memory solutions across different suppliers, which it described as a faster route to getting semi-custom AI chips into production.
One of the first applications, according to NVIDIA, will involve Amazon’s Annapurna Labs. NVIDIA said Annapurna Labs will be the first to work on NVHBM as part of a broader collaboration with NVIDIA around NVLink Fusion, including work to enhance performance and efficiency for AI workloads. NVIDIA also quoted Nafea Bshara, vice president of Annapurna Labs, who said the company looks forward to the technology collaboration for future AWS infrastructure designs.
NVIDIA also tied the NVHBM effort to its broader plan for making custom chips work together at the rack level. The company said NVLink Fusion enables partners to connect custom XPUs and CPUs to NVIDIA’s rack-scale platform. In addition to NVIDIA’s own building blocks, it said partners can access NVLink chiplets, NVLink-C2C, NVLink switches, and NVIDIA MGX systems and racks, alongside an ecosystem that includes CPU partners, ASIC designers, system manufacturers, and other technology providers.
The company positioned this expansion as part of a larger pipeline of next-generation AI hardware. NVIDIA said Annapurna Labs will support NVLink Fusion with next-generation Trainium chips starting with Trainium4, allowing Amazon chips and NVIDIA GPUs to work together using a common rack-scale architecture. Separately, NVIDIA said that AWS previously announced support for NVLink Fusion, and that the new memory technology is designed to extend the capability to NVLink Fusion customers.
What NVIDIA did not specify in its announcement is the full product timeline for widespread availability of NVHBM across customer designs, or the specific validation results partners can expect beyond the stated bandwidth, power, and die-area targets. The company also did not provide detailed benchmarking numbers in the post, such as throughput or application-level performance on particular AI models, leaving room for partners to publish their own results as implementations are validated.
For the next phase, investors and customers will likely watch how quickly multiple memory providers can deliver standardized NVHBM components, and whether Annapurna Labs’ first work translates into production-ready AI racks using Trainium4 and NVIDIA GPUs. NVIDIA’s next steps may also hinge on how well the NVHBM approach supports the company’s goal of making semi-custom AI infrastructure a lower-risk, faster-to-deploy path across both hyperscaler deployments and AI-native system builders.
Why It Matters
- Memory architecture is increasingly a limiting factor for AI systems, so changes like relocating the memory controller may materially affect performance and power at scale.
- By standardizing NVHBM across suppliers, NVIDIA is trying to reduce the cost and timeline risk of building semi-custom AI chips.
- If validated designs using NVLink Fusion and Trainium4 proceed as described, it could strengthen the practical interoperability between hyperscaler ASICs and NVIDIA GPUs at the rack level.
- The move highlights a broader industry shift toward co-designing compute, memory, and interconnects rather than treating them as separate components.
Sources
Key Facts
- NVIDIA expanded NVLink Fusion with a new memory technology called NVHBM, aimed at boosting memory performance and efficiency for AI processing units.
- NVHBM integrates NVIDIA’s custom memory controller into the 3D HBM stack instead of placing it on the XPU die.
- NVIDIA said NVHBM delivers up to 30% greater memory bandwidth and 15% lower HBM power consumption, and can free up to 25% more XPU compute-die area versus standard HBM4E.
- NVIDIA said it is establishing NVHBM as a standard implementation available from multiple memory providers to reduce integration and qualification effort.
- Amazon’s Annapurna Labs will be the first partner to work on NVHBM as part of its collaboration with NVIDIA on NVLink Fusion, starting with Trainium4 support for rack-scale, multi-vendor architectures.
Technology Related
Nvidia reports a sharp sales jump, but investors focus on what comes next
Nvidia’s latest quarterly results topped expectations and showed a year-over-year surge in revenue, yet the market reaction hinged less on the past quarter and more on the company’s outlook for continued growth.
Nvidia reports stronger fiscal second-quarter adjusted results and lifts revenue, then reframes its margin outlook for the next stretch
In an earnings update carried by Yahoo Finance, Nvidia said adjusted earnings and revenue rose in fiscal second quarter, while management reset expectations around margins and set the tone for fiscal third quarter.
Meta’s proposed $18B child-safety settlement puts age verification at the center of the privacy debate
A major child-safety agreement tied to Meta’s platforms has renewed scrutiny of the age-verification methods being used, with critics arguing the technology is unreliable and raises privacy concerns.
Nvidia shares slip after earnings release raises questions about the durability of its gross margin
The latest Nvidia earnings update triggered a sharp focus on profitability, with investors reacting to indications that the company’s high-margin profile may soften slightly.
Amazon plans to add 2 million Nvidia GPUs to expand data-center capacity for AI
The move, outlined in a report citing plans to purchase additional Nvidia graphics processing units over the next two years, underscores how aggressively cloud operators are investing in AI compute.
Salesforce faces AI scrutiny as it updates investors on Q2 2027 results and outlook
A Yahoo Finance recap of Salesforce’s latest quarterly earnings call focused on how management is positioning its software and AI strategy in a market anxious about disruption. The company’s most precise financial details were not provided in the available excerpt.
NVIDIA’s reported $96.2 billion quarter reinforces its role as the central supplier of AI computing capacity
The company’s latest results, as reported in a market update, point to continued demand for data center infrastructure, with Data Center revenue accounting for the bulk of the quarter’s total.
Nvidia pushes back on “circular financing” claim as AI partnership scrutiny grows
In remarks reported by Yahoo Finance, Nvidia said its network of AI partnerships is strategic rather than a financial loop, even as investors and critics look more closely at how the chipmaker’s capital ties intersect with demand for its hardware.
Nvidia reports fiscal 2027 second-quarter results ahead of expectations and issues a strong outlook
The company’s latest quarter topped Wall Street’s forecasts, and its forward guidance reinforced investor optimism around continued demand for its AI and data-center computing products.
Stocks Edge Lower as Inflation Fears Rise and Investors Await Nvidia Earnings
A hotter-than-expected July inflation read and higher bond yields shifted expectations for rate cuts, nudging equities down and pressuring chip-related names ahead of Nvidia’s earnings. The market also digested a new ruling involving Meta.