Software & Technology · Topic
Ai Inference
3 articles from Software & Technology practitioners
Custom AI Chips Signal Segmentation for AI Teams, While NVIDIA Sets the Performance Ceiling for Cutting-Edge AI
Microsoft’s introduction of the Maia 200 adds to a growing list of hyperscaler-developed processors, alongside offerings from AWS and Google. These custom AI chips are largely designed to improve inference efficiency and optimize internal cost structures, though some platforms also support large-scale training. Google’s offering is currently the most mature, with a longer production…
OpenAI–Cerebras Deal Signals Selective Inference Optimization, Not Replacement of GPUs
OpenAI’s partnership with Cerebras has raised questions about the future of GPUs in inference workloads. Cerebras uses a wafer-scale architecture that places an entire cluster onto a single silicon chip. This design reduces communication overhead and is built to improve latency and throughput for large-scale inference. QumulusAI Senior Product Manager Mark Jackson says Cerebras’…
Applied Digital Redefines Modern Computing with Unmatched Hosting Power for NVIDIA H100 Servers
As the digital landscape continues to evolve at a rapid pace, Applied Digital emerges as a key player in reshaping data center infrastructure. In a recent episode of the AI-First Business Podcast, the spotlight was on Applied Digital’s pioneering approach to meeting the burgeoning demands of modern computing. Host Tina Yazdi welcomed Wes Cummings,…