MarketScale
‹ Back to Industries

Software & Technology

On-Prem or Cloud? Either Way, Data Center Compute Demands Necessitate the Need for AI Accelerators

With the increasing demand for powerful data center compute capabilities, data centers are at the forefront of driving the need, development, and purchase of AI accelerators. This surge is influenced by the expanding role of AI in business operations, creating a critical demand for advanced hardware solutions. How are data centers shaping the…

This story was produced through MarketScale. See how Software & Technology teams put it to work with Code to Content.

By Mark Beccue · Ai AcceleratorsData Center ComputeData CentersExperts Talk
Share

Key takeaways

01

With the increasing demand for powerful data center compute capabilities, data centers are at the forefront of driving the need, development, and purchase of AI accelerators.

02

This surge is influenced by the expanding role of AI in business operations, creating a critical demand for advanced hardware solutions.

03

How are data centers shaping the…

With the increasing demand for powerful data center compute capabilities, data centers are at the forefront of driving the need, development, and purchase of AI accelerators. This surge is influenced by the expanding role of AI in business operations, creating a critical demand for advanced hardware solutions.

How are data centers shaping the landscape of AI compute, and what strategic decisions should businesses consider in this evolving environment?

In a recent Experts Talk roundtable discussion, Mark Beccue, a top AI market research analyst, expanded on the nuances of data center compute and the pivotal role of AI accelerators. His expert analysis offers valuable insights into the current trends and strategic considerations for enterprises navigating this complex terrain.

Main Takeaways from Mark Beccue’s Analysis:

  • Data Center Compute: Heavy computational loads handled by data centers fall into two categories: on-premises (on-prem) and cloud-based solutions
  • Enterprise Decisions: Enterprises must choose between investing in on-prem data centers or leveraging cloud services from providers like Amazon, Azure, and Google
  • Pros and Cons: Cloud services offer quick deployment and scalability, but data security remains a significant concern for many companies
  • Market Trends: The limited availability of compute resources in the market drives strategic decisions about whether to build on-prem from scratch or rely on cloud services
  • Strategic Considerations: Enterprises need to weigh the benefits of speed and scale against the challenges of data security and management when choosing their AI infrastructure

For a more in-depth discussion, view the complete roundtable conversation.

Article by MarketScale

Video TranscriptExpand ↓

A little bit is, I'm gonna focus back on what's called data center, you know, compute. So that's the really heavy load computes. What you have is cloud versus on prem. And, so you have a lot of enterprises that have their own data centers, and they they call that on prem. And they and so you ask where these things get bought. The those all of these sophisticated accelerators get bought in the data centers either on prem, so that's an enterprise buying it themselves, or by the cloud players being, you know, the Amazons, the, Azures, you know, Google, and those types of things. And what there's a debate, I guess. You know, you can say, it's not a real great time to start building your on prem if you wanna start from scratch. But, you know, compute is a a a narrow it's a limited commodity right now, I think, we're seeing in the marketplace. So a lot of enterprises are making decisions. If they don't have on prem, they're everybody's thinking about the cloud. Is this a good idea or not? You know, there are pros and cons to those things. The pros being you're up and running much quicker. There's some scale to that. The cons being, you know, how you handle your data. Security is always an issue for lots of companies, but that's where I would say is kinda one of the bigger challenges around what we're talking about.

About the author

Mark Beccue
Mark BeccueResearch Director

Mark Beccue is a veteran market research analyst with more than 25 years of experience in market research and business strategy. Mark is one of a handful of pioneering analysts who began to focus on AI market research in 2015. Today with Futurum Group and previously as a principal analyst within the AI practice area at Omdia and Tractica, he has advised clients and provided them with syndicated and custom qualitative AI research services. His expertise in AI use cases, applications and software, natural language AI and broader trends surrounding AI market adoption have made him a well-known and sought after speaker, panel moderator, conference chair and media resource within the AI business community. He has served in those roles for events including the AI Summits in London, Singapore, New York and Silicon Valley, IOT World, Smart Home Summit, UX Next and Telco AI Europe. Prior to joining Tractica, Mark was an independent market research analyst focused on emerging technologies. Before going independent, Mark served as in house market intelligence analyst for Syniverse, where he helped guide overall business and product line strategies. For 4 years Mark worked as a Senior Analyst for ABI Research, a global technology research firm, focusing on mobile consumer services. Prior to ABI, Mark worked for 10 years for Syniverse in product management, greenhouse innovation and marketing. Specialties: AI B2B and B2C market intelligence, analysis and insights. Natural Language AI. Operationalizing AI in the Enterprise. AI market adoption trends and issues. Strengths - AI and other technical market analysis designed for business readers, writing, thought leadership, forecasting, market sizing

Free workspace

You just read one expert. Imagine publishing your whole team.

This article was produced through MarketScale. Create a free workspace and turn your own team's expertise into articles, video, and social posts. No credit card, no demo required.

Start freeBook a demoNPS +73 · 1,000+ creators · 38+ countries

Explore More Software & Technology Insights

Read more expert perspectives from across Software & Technology.

Browse Software & Technology Hub

About the Expert

MB
Mark Beccue