Skip to content
‹ Back to IndustriesSoftware & Technology

Nvidia's Next AI Rack Costs Nearly Double the Last One, and Memory Is Why. What Infrastructure Buyers Should Budget For.

Nvidia's next-generation Vera Rubin rack will cost hyperscalers $7.8 million—nearly double the prior generation—with memory now accounting for 25-30% of total cost instead of 5-10%. This shift signals that AI infrastructure budgeting must focus on total system cost rather than GPU pricing alone.

This story was produced through MarketScale. See how Software & Technology teams put it to work with Executive Thought Leadership.

· NvidiaVera RubinAi InfrastructureMemory Prices
Share
Listen to the audio brief

Key facts, context, and what it means.

AUDIO
0:00—
Nvidia's Next AI Rack Costs Nearly Double the Last One, and Memory Is Why. What Infrastructure Buyers Should Budget For.

Key takeaways

01

Memory costs jumped 435% to roughly $2 million per rack due to increased LPDDR5X capacity and 3D NAND storage, making it a strategic budget variable across all technology purchases

02

GPU share of bill of materials fell from 63% to 51% while memory rose to 25-30%, requiring infrastructure planners to model AI spend on total system cost not accelerator count

03

Memory supply constraints and tight availability now warrant the same scheduling and planning attention as GPU allocation, with procurement structure able to move final pricing by $1+ million per rack

Free workspace

Turn your Software & Technology expertise into content.

Record interviews, organize footage, and write with AI on a free trial of the MarketScale platform for qualifying companies. No demo required, no credit card.

Try it Free

The single most expensive part of Nvidia's next-generation AI rack is no longer just the GPU. According to a Morgan Stanley bill-of-materials analysis, memory now accounts for roughly a quarter of the total, and the overall system price has nearly doubled generation over generation. For any organization budgeting AI infrastructure for the second half of 2026 and beyond, that shift changes how the numbers should be built.

The numbers

Morgan Stanley Research estimates that Nvidia's Vera Rubin VR200 NVL72 rack will cost hyperscale cloud providers around $7.8 million per unit, up from roughly $4 million for the current GB300 NVL72 generation. The GPUs themselves are not the driver of the increase. The bank estimates Nvidia will charge about $55,000 per Rubin GPU and $5,000 per Vera CPU when sold in volume.

The memory line is where the cost concentrates. Morgan Stanley puts memory content per rack at about $2 million, a 435% jump from the prior generation, driven by a threefold increase in LPDDR5X capacity to 54 terabytes per rack plus roughly $1 million or more in 3D NAND storage that was virtually absent from earlier systems. First shipments are scheduled for the third quarter of 2026, with volume ramping in the fourth.

As a share of the bill of materials, memory rose from 5 to 10 percent on the GB200 to 25 to 30 percent on the VR200, while the GPU's share fell from roughly 63 percent to 51 percent.

Why this reaches beyond hyperscalers

Only a handful of companies buy racks at this scale. But the force behind the price, constrained supply of DRAM, NAND, and high-bandwidth memory against AI-driven demand, is the same one now raising component costs across the market. Contract DDR5 pricing has climbed sharply, and device makers including Samsung and Apple are expected to pass higher memory costs into upcoming products. The AI buildout and the price of the memory in a laptop are now tied to the same supply squeeze.

For enterprise technology buyers, that means memory has become a strategic budget variable rather than a rounding error, whether the purchase is a data center commitment or a fleet refresh.

What infrastructure planners should account for

Three considerations follow directly from the Morgan Stanley breakdown.

  • Model your AI spend on total system cost, not GPU count. The generation-over-generation story is that peripheral components, memory, printed circuit boards, networking, cooling, and power, are absorbing a larger share of every dollar. Budgets built around GPU headline prices will understate the real bill.
  • Treat memory supply as a scheduling risk, not only a cost. With memory representing a quarter or more of rack value and supply tight, availability and lead times deserve the same planning attention as accelerator allocation.
  • Revisit the build-versus-rent math. As rack prices climb toward $8 million and memory pricing stays volatile, the calculus between owning infrastructure and consuming cloud capacity shifts. Morgan Stanley notes that a hyperscaler self-sourcing certain memory modules could bring the rack price down to around $6.7 million, a reminder that procurement structure now materially moves the number.

The bottom line

Nvidia's Vera Rubin platform will deliver a step change in performance, and demand is not in question. What has changed is where the money goes. The AI infrastructure bill is increasingly a memory bill, and the organizations planning capacity for the next two years will be the ones that budget for the full system rather than the chip on the front of the box.

Featured companies

Your experts belong here

Every story in MarketScale Software & Technology starts with a company putting its solutions engineers, product teams, and customer engineers on the record. Buyers are already reading this topic. The only question is whose experts they find.

Buyers ask AI engines who to consider, and published expert answers are what those engines cite.

Book DemoSee how it works15 minutes, straight to a calendar.
B2B Weekly

The week in Software & Technology, and sixteen other industries, every Monday.

Ten stories, one-line takes, five minutes. Free.

Software & Technology: are you visible to AI?

Before they reach out, Software & Technology buyers ask AI engines which vendors to trust. Explore how your experts, customers, and partners can become useful content for buyers and AI search.

Free Trial

You just read one Software & Technology expert. Your company is full of them.

This article was produced through MarketScale. The same platform turns your solutions engineers, product teams, and customer engineers into the articles, video, and social content Software & Technology buyers are searching for. Start a free trial and see it with your own people. For qualifying companies, no credit card, no demo required.

NPS +73 · 1,000+ creators · 38+ countries

What your free trial includes

Hands-on access to the MarketScale platform
Media requests to your crowd, remote recording, AI writing tools
No demo required. No credit card.
For qualifying companies. Company confirmation required.

More Software & Technology Insights

CloudWatch Omni rollouts are decided before the first team signs in

CloudWatch Omni rollouts are decided before the first team signs in

Amazon CloudWatch Omni puts application and AI agent observability behind one sign-in URL. Its key setup choices are hard to undo: the domain stays in the IAM Identity Center primary Region and centralization rules skip historical data. According to AWS, Omni does not automatically detect or redact personally identifiable information, and no data is removed unless you configure it.

  • 01Omni centralization rules capture only telemetry that arrives after they are created, so the date the rules go live sets how far back incident teams can look.
  • 02Omni does not detect or redact personal data on its own; capture-time redaction is the only layer that meets the requirement that data never be exported and it cannot be reversed.
  • 03Organizations with data residency rules should settle their IAM Identity Center primary Region before creating the Omni domain, because the domain has to stay in that Region.

Nov 19, 2026

ServiceNow wants AI agents to chase the unpaid invoices too small for staff

ServiceNow wants AI agents to chase the unpaid invoices too small for staff

ServiceNow's EmployeeWorks reached $100 million in its first three quarters, and the company is now aiming AI agents at accounts payable and receivable. Kahn suggested a volume-priced AP agent could end up compared with outsourced AP contracts as much as other software. Finance teams will mostly meet these tools through existing ServiceNow contracts, and the strongest benchmarks still come from IT, where Leidos expects up to 60% of tickets resolved with no human involved.

  • 01For now, ServiceNow's autonomous finance tools are selling mostly to existing ServiceNow customers, so the first accounts payable agent many finance teams evaluate will arrive through a platform the company already pays for.
  • 02A volume-priced AP agent would be measured on finance’s own before-and-after metrics—days sales outstanding, captured discounts and duplicate invoices caught—rather than broad productivity claims.
  • 03ServiceNow estimates that 10% to 20% of revenue in its Core Business unit may involve hands-on engineering help, a reason to price implementation work into complex finance projects up front.

Nov 18, 2026

GTA VI preloads broke Virgin Media O2’s daily data record

GTA VI preloads broke Virgin Media O2’s daily data record

Virgin Media O2 set a daily data record on its UK fixed broadband network during GTA VI preloads. Comcast and Fastly describe how nearby servers can shorten a file’s journey. A branch-office example shows how to measure that benefit during a software rollout.

  • 01PlayStation and Xbox preloads opened together at midnight in Britain on November 10.
  • 02Virgin Media O2’s full-day data volume exceeded its previous record by 4%.
  • 03A branch office can compare the bytes crossing its internet connection with the bytes its laptops receive.

Nov 18, 2026

Explore More Software & Technology Insights

Read more expert perspectives from across Software & Technology.

Browse Software & Technology Hub

For B2B teams

Your experts could be publishing here

Stories like this one run on content MarketScale captures from real practitioners. See how your team's expertise becomes coverage in Software & Technology and beyond.

Book a Demo

Or call us. No forms required. We pick up. 214-945-2512