Skip to content
MarketScale
‹ Back to IndustriesSoftware & Technology

On-Prem or Cloud? Either Way, Data Center Compute Demands Necessitate the Need for AI Accelerators

With the increasing demand for powerful data center compute capabilities, data centers are at the forefront of driving the need, development, and purchase of AI accelerators. This surge is influenced by the expanding role of AI in business operations, creating a critical demand for advanced hardware solutions. How are data centers shaping the…

This story was produced through MarketScale. See how Software & Technology teams put it to work with Executive Thought Leadership.

By Mark Beccue · Ai AcceleratorsData Center ComputeData CentersExperts Talk
Share

Key takeaways

01

With the increasing demand for powerful data center compute capabilities, data centers are at the forefront of driving the need, development, and purchase of AI accelerators.

02

This surge is influenced by the expanding role of AI in business operations, creating a critical demand for advanced hardware solutions.

03

How are data centers shaping the…

With the increasing demand for powerful data center compute capabilities, data centers are at the forefront of driving the need, development, and purchase of AI accelerators. This surge is influenced by the expanding role of AI in business operations, creating a critical demand for advanced hardware solutions.

How are data centers shaping the landscape of AI compute, and what strategic decisions should businesses consider in this evolving environment?

In a recent Experts Talk roundtable discussion, Mark Beccue, a top AI market research analyst, expanded on the nuances of data center compute and the pivotal role of AI accelerators. His expert analysis offers valuable insights into the current trends and strategic considerations for enterprises navigating this complex terrain.

Main Takeaways from Mark Beccue’s Analysis:

  • Data Center Compute: Heavy computational loads handled by data centers fall into two categories: on-premises (on-prem) and cloud-based solutions
  • Enterprise Decisions: Enterprises must choose between investing in on-prem data centers or leveraging cloud services from providers like Amazon, Azure, and Google
  • Pros and Cons: Cloud services offer quick deployment and scalability, but data security remains a significant concern for many companies
  • Market Trends: The limited availability of compute resources in the market drives strategic decisions about whether to build on-prem from scratch or rely on cloud services
  • Strategic Considerations: Enterprises need to weigh the benefits of speed and scale against the challenges of data security and management when choosing their AI infrastructure

For a more in-depth discussion, view the complete roundtable conversation.

Article by MarketScale

Video TranscriptExpand ↓

A little bit is, I'm gonna focus back on what's called data center, you know, compute. So that's the really heavy load computes. What you have is cloud versus on prem. And, so you have a lot of enterprises that have their own data centers, and they they call that on prem. And they and so you ask where these things get bought. The those all of these sophisticated accelerators get bought in the data centers either on prem, so that's an enterprise buying it themselves, or by the cloud players being, you know, the Amazons, the, Azures, you know, Google, and those types of things. And what there's a debate, I guess. You know, you can say, it's not a real great time to start building your on prem if you wanna start from scratch. But, you know, compute is a a a narrow it's a limited commodity right now, I think, we're seeing in the marketplace. So a lot of enterprises are making decisions. If they don't have on prem, they're everybody's thinking about the cloud. Is this a good idea or not? You know, there are pros and cons to those things. The pros being you're up and running much quicker. There's some scale to that. The cons being, you know, how you handle your data. Security is always an issue for lots of companies, but that's where I would say is kinda one of the bigger challenges around what we're talking about.

About the author

Mark Beccue
Mark BeccueResearch Director

Mark Beccue is a veteran market research analyst with more than 25 years of experience in market research and business strategy. Mark is one of a handful of pioneering analysts who began to focus on AI market research in 2015. Today with Futurum Group and previously as a principal analyst within the AI practice area at Omdia and Tractica, he has advised clients and provided them with syndicated and custom qualitative AI research services. His expertise in AI use cases, applications and software, natural language AI and broader trends surrounding AI market adoption have made him a well-known and sought after speaker, panel moderator, conference chair and media resource within the AI business community. He has served in those roles for events including the AI Summits in London, Singapore, New York and Silicon Valley, IOT World, Smart Home Summit, UX Next and Telco AI Europe. Prior to joining Tractica, Mark was an independent market research analyst focused on emerging technologies. Before going independent, Mark served as in house market intelligence analyst for Syniverse, where he helped guide overall business and product line strategies. For 4 years Mark worked as a Senior Analyst for ABI Research, a global technology research firm, focusing on mobile consumer services. Prior to ABI, Mark worked for 10 years for Syniverse in product management, greenhouse innovation and marketing. Specialties: AI B2B and B2C market intelligence, analysis and insights. Natural Language AI. Operationalizing AI in the Enterprise. AI market adoption trends and issues. Strengths - AI and other technical market analysis designed for business readers, writing, thought leadership, forecasting, market sizing

Software & Technology: are you visible to AI?

Before they reach out, Software & Technology buyers ask AI engines which vendors to trust. See how AI describes your company today, and where competitors show up instead.

Free workspace

You just read one Software & Technology expert. Imagine publishing your whole team.

This article was produced through MarketScale. Create a free workspace and turn your own team's Software & Technology expertise into the articles, video, and social content B2B marketing buyers in your industry are searching for. No credit card, no demo required.

NPS +73 · 1,000+ creators · 38+ countries

What you get, free

Your own MarketScale Studio workspace
One video edit a month, on us
AI writing, editing, and publishing tools
In-platform coaching to learn the system

More Software & Technology Insights

AppViewX ships hybrid PQC certificates and an MCP server as machine identities hit a 144-to-1 ratio over humans

AppViewX ships hybrid PQC certificates and an MCP server as machine identities hit a 144-to-1 ratio over humans

AppViewX has launched its Summer 2026 product update, introducing hybrid post-quantum certificates and a machine credential processing server designed with AI capabilities. This release comes as enterprises confront the increasing complexity of cryptographic requirements due to the massive growth of machine identities. Machine identities now outnumber human identities by 144 to 1.

  • 01AppViewX's Summer 2026 update includes hybrid post-quantum certificates to enhance security.
  • 02Machine identities currently have a 144-to-1 ratio compared to human identities.
  • 03An AI agent-native MCP server is part of the new features addressing cryptographic challenges.

Aug 2, 2026

The 2026 Forbes AI 50 reveals a $305.6 billion private market consolidating fast around a handful of giants

The 2026 Forbes AI 50 reveals a $305.6 billion private market consolidating fast around a handful of giants

The Forbes AI 50 list in 2026 highlights a $305.6 billion private AI market that is rapidly being dominated by a few major companies. OpenAI and Anthropic together account for 80% of the total funding among the listed companies, indicating a significant capital concentration. However, the emergence of 20 newcomers suggests that there remains room for innovation and growth, especially in sectors like fintech.

  • 01OpenAI and Anthropic account for 80% of the total funding on the Forbes AI 50.
  • 02The total market size for the AI industry is valued at $305.6 billion.
  • 03There are 20 new companies on the Forbes AI 50 list, indicating continued innovation.

Aug 1, 2026

Employee distrust and skills gaps are the real barriers slowing enterprise AI scale in 2026

Employee distrust and skills gaps are the real barriers slowing enterprise AI scale in 2026

The main challenges to scaling enterprise AI in 2026 are employee distrust and a widening skills gap rather than technological readiness. Companies like Microsoft, Salesforce, and Google have the platforms ready, but workforce trust and skills remain barriers.

  • 01Employee distrust is a significant barrier to scaling enterprise AI.
  • 02A widening AI skills gap is hindering technological progress within companies.
  • 03Platforms from major companies like Microsoft, Salesforce, and Google are technically ready for AI scaling.

Aug 1, 2026

Explore More Software & Technology Insights

Read more expert perspectives from across Software & Technology.

Browse Software & Technology Hub

About the Expert

Mark Beccue
Mark Beccue

Research Director

Mark Beccue is a veteran market research analyst with more than 25 years of experience in market research and business strategy. Mark is one of a handful of pioneering analysts who began to focus on AI market research in 2015. Today with Futurum Group and previously as a principal analyst within the AI practice area at Omdia and Tractica, he has advised clients and provided them with syndicated and custom qualitative AI research services. His expertise in AI use cases, applications and software, natural language AI and broader trends surrounding AI market adoption have made him a well-known and sought after speaker, panel moderator, conference chair and media resource within the AI business community. He has served in those roles for events including the AI Summits in London, Singapore, New York and Silicon Valley, IOT World, Smart Home Summit, UX Next and Telco AI Europe. Prior to joining Tractica, Mark was an independent market research analyst focused on emerging technologies. Before going independent, Mark served as in house market intelligence analyst for Syniverse, where he helped guide overall business and product line strategies. For 4 years Mark worked as a Senior Analyst for ABI Research, a global technology research firm, focusing on mobile consumer services. Prior to ABI, Mark worked for 10 years for Syniverse in product management, greenhouse innovation and marketing. Specialties: AI B2B and B2C market intelligence, analysis and insights. Natural Language AI. Operationalizing AI in the Enterprise. AI market adoption trends and issues. Strengths - AI and other technical market analysis designed for business readers, writing, thought leadership, forecasting, market sizing

For B2B teams

Your experts could be publishing here

Stories like this one run on content MarketScale captures from real practitioners. See how your team's expertise becomes coverage in Software & Technology and beyond.

Book a 15-minute demo

Or call us. No forms required. We pick up. 214-945-2512