Amazon’s Trainium Takes a Strike at the Training King
Trainium Best for Inference? But now good for Training too, Native Trainium PyTorch, High Quality CI, TorchTitan, GPU Impossible Profiler
Latest from SemiAnalysis
RSSThe Huawei-DeepSeek Symbiosis
Huawei Ascend 950PR Deep dive & µbenchmarks, DSv4.1 Flash Analysis, DeepSeek support for Ascend
Datacenters 2027: The Year of Acceleration, +50GW in a Single Year
60GW Under Construction, SemiAnalysis Leading Indicators, 1.3T of Lease Contracts Signed YTD, The Shortage Could Move to Chips
ASML Is Building a Hybrid Bonding Tool!
ASML is building a hybrid bonding tool! The company has not announced anything yet, but its patent filings, a news report and its own roadmap all suggest so.
Beijing Will Not Pace the Frontier: China’s Speed-First AI Safety Regime
AI safety is on fire.
Anthropic Subscriptions Offer 5x+ More Value Than OpenAI
Limit testing every AI subscription plan from Anthropic, OpenAI, Meta, SpaceXSI, MiniMax, Moonshot, Z.ai, Cursor, and Cognition
How GLM5.3 Sparse Attention Affects HBM Memory Usage
GLM-5.3, KV Cache Offloading, HiSparse, DeepSeek Sparse Attention, IndexShare, Single-rollout Asynchronous Optimization, Cybersecurity
Intel Panther Lake Teardown
Looking inside Intel 18A and Intel’s Panther Lake. A free SemiAnalysis STEEL teardown.
The Chinese AI Infrastructure Boom: Introducing the SemiAnalysis China Datacenter Model
1,000+ facilities across 60+ operators mapped, built retail-first and flipped by AI, largest hyperscaler leases 1/5 national capacity, 100MW in 12 months, Eastern Data Western Compute
ClusterMAX 3.0: The Industry Standard GPU Cloud Rating System Returns
In gory detail: reliability, performance, support, pricing—and, of course, security—in our most thorough analysis of GPU cloud providers globally.
Computation and Data Movement for Inference
Mapping MoE models onto inference hardware: structure, flow, and efficient serving
Engrams Embedding Entendre: Codesign for Efficient DRAM/SSD Offloading
New Model Architecture Implications for TAM of DRAM/NVMe, DeepSeek V4.1 Flash, AgentX, InferenceX, NVMe experiments
Everyone Says Datacenter Moratoriums Are Killing the US Buildout. We disagree
20GW sits inside a restricted local boundary, 1,525MW actually slips, 2.3GW nationwide including New York
Vera Rubin NVL72 Agentic Inference: 67x better Performance per Dollar
Jensen Sandbagging Performance Again, 2x more Annual Profit Per GigaWatt, The More you Buy, The More you Earn, AgentX, InferenceX, Extreme Co-Design
A Brain Too Big to Carry — On-Device vs Datacenter Inference
Robot Models, Silicon Efficiency, Jetson Thor vs. B300 TCO, Deployments, The Network Wall
Long Live the Short King: Why 4-hi HBM Wins
Same Bandwidth, Fewer Dies: How 4-hi HBM Cuts Inference Costs and Makes Scarce DRAM Go Further
Nvidia’s Backstop Universe – Heads I Win, Tails Who Loses?
The $11T AI Buildout, Nvidia’s Backstop Economics, and the Limits of Nvidia’s Balance Sheet
What is So Hard About Behind-The-Meter Power For Datacenters? Part 1
Dumb Science Experiments vs. Money Printing Machines
TPU Inference Externalization Full Steam Ahead - InferenceX
InferenceX, Up to 50% Better Performance per Dollar, Rapid Externalization of TPU stack, Growing Customer Base, Ironwood, TPUv8i, Reducing CUDA Moat
Korea’s Trillion-Dollar Sovereign AI Investment: Nvidia Wins, Hynix Loses
Korea hosts a Squid Games, National AI Tournament, the best non-Chinese open source model gets eliminated, why Nvidia needs open source, implications for Hynix and Samsung