AI Infrastructure Is Cracking at the Seams
The enterprise AI tax is real. and you’re probably paying it
The Bottom Line (No Jargon Edition)
OpenAI slashed prices on its GPT-5.6 Luna model by 80%, down to $0.20 per million input tokens. Anthropic held flat at $5/$25. Two different bets on where the market is heading.
AWS GPU capacity will stay constrained through 2027. Andy Jassy said so publicly. If your team relies on reserved GPU instances, your wait times and costs are both going up.
Meta dropped Muse Glimmer. a 30B multimodal model, Apache 2.0, running on a single consumer GPU with 18-20 GB of memory. Capable enough for local agentic workflows, coding, and function calling. No API bill required.
Nvidia disclosed a $21 billion stake in SpaceX (122.8 million Class A shares). That is not a passive investment. Nvidia is buying a seat at the table for satellite-based compute infrastructure.
Enterprise teams that signed single-vendor AI contracts in early 2026 are overpaying by multiples compared to current market rates. The pricing floor fell out from under them.
The Take That Started the Week
On Monday morning, the OpenAI pricing announcement hit. GPT-5.6 Luna at $0.20 input / $1.20 output per million tokens. For context: that is an 80% cut from where comparable OpenAI models were sitting six months ago. Chinese rivals. Kimi K2.6 and others. have been applying relentless downward pressure, and the US frontier labs are now responding with their wallets.
Anthropic took the opposite position. Claude Opus 4.8 held at $5/$25. The faster inference tier costs $10/$50. That is a deliberate signal. Anthropic is betting on quality differentiation holding the price line. OpenAI is betting on volume and efficiency. Both bets are rational. Only one of them is right for your specific workload, and the answer is different depending on whether you are running high-volume retrieval or complex reasoning chains.
The part that matters most for practitioners: every enterprise contract signed at 2025 inference rates is now an anchor. If you locked in a platform agreement six months ago, you built cost models on a floor that no longer exists. The market repriced fast and re-priced hard. Whether you are running on Azure OpenAI Service, Bedrock, or Vertex, the underlying model economics shifted under your feet. The renegotiation conversation is worth having now, not at renewal.
What I am watching is whether Anthropic’s hold-the-line strategy survives. The firm was reportedly profitable in Q2 2026. That result will be difficult to repeat if the inference price floor keeps falling and they refuse to follow it down.
Cloud Roundup
AWS
GPU capacity is the story. CEO Andy Jassy publicly acknowledged that compute supply will not meet customer demand through 2027. Amazon’s disclosed backlog hit $496 billion with triple-digit year-over-year growth, which tells you the demand signal is real. The problem for enterprise buyers: the hyperscalers that secured power capacity and supply-chain commitments years ago are sitting on an asset. You are not. Enterprises should be securing capacity commitments now, before the shortage deepens. The era of spinning up a P5 instance on demand is over for most teams.
On the compliance side: Qualys shipped real-time CSPM that bridges AWS and Azure in a single event-driven queue, pulling from CloudTrail and Azure Event Hubs. Sub-minute detection. For hybrid shops managing posture across both clouds, this closes a meaningful gap without requiring two separate toolchains.
Azure
Microsoft has been the quiet beneficiary of AWS’s capacity crunch. Multi-cloud inference setups are increasingly common. teams running inference on one cloud while keeping storage, identity, and networking on another. Azure’s identity integrations give it a structural stickiness advantage when GPU capacity gets tight elsewhere. Nothing dramatic from Redmond this week, but the market is moving toward them by default.
GCP
Google Cloud posted 63% growth this quarter, outpacing both AWS and Azure on percentage growth. TPU-based inference is the play. Teams that can tolerate the operational complexity of TPUs are finding meaningfully better price-performance on repetitive inference workloads. Google secured power and data center capacity early. That early infrastructure bet is paying off in the scarcity environment.
AI Model Roundup
OpenAI
The GPT-5.6 tier structure is now explicit: Sol ($5/$30), Terra ($2/$12), Luna ($0.20/$1.20). That is a three-tier price ladder designed to capture every segment from high-reliability enterprise reasoning down to high-volume commodity inference. The 80% cut on Luna is not a distress signal. it is a market-making move. OpenAI is trying to own the volume tier before open-weight models do it for free.
Anthropic
Claude Opus 4.8 shipped May 28, six weeks after 4.7. Pricing held flat at $5/$25 standard, $10/$50 fast. Anthropic has been vocal about quality as the differentiator. The risk in that position is real: if open-weight models close the quality gap. and Muse Glimmer suggests the gap is closing at the 30B scale. the price premium becomes harder to justify for workloads that don’t genuinely require frontier reasoning. Steve Eisman called them the “Achilles’ heel” of the AI trade. That framing is aggressive, but the underlying concern is legitimate.
Google AI (Gemini)
Google is running a two-pronged play: aggressive Gemini pricing through Vertex AI to match the OpenAI volume push, while maintaining a quality tier for complex tasks. The advantage Google holds is vertical integration. TPU silicon, cloud infrastructure, and model development all under one roof. No other lab has that combination. The disadvantage is enterprise sales motion, which remains slower and more friction-heavy than AWS or Azure.
Meta / Open Source
Muse Glimmer is the headline this week. 29.6 billion parameters, dense Transformer architecture, Apache 2.0, weights on Hugging Face, runs in 18-20 GB of memory. Hardware optimizations for AMD, Arm, Dell, Intel, and Nvidia. Released August 10 by Meta Superintelligence Labs under Chief AI Officer Alexandr Wang. This is the model the open-source community has been waiting for at the agentic tier. It runs local coding workflows, function calling, and multi-step agent tasks on a consumer Mac or PC without a cloud API in the loop. I will come back to why this is important in the pattern section.
The Pattern I’m Watching
I have watched this exact sequence before. Virtualization made server hardware cheap. Containers made deployment cheap. Cloud made compute provisioning cheap. Each time, the commoditization of the foundational layer forced the economic value to migrate upward into the tooling, the orchestration, and the integration layer. Muse Glimmer running on your laptop for free is that moment for AI model weights.
When a 30B multimodal model ships under Apache 2.0 and fits in consumer GPU memory, the model is no longer the scarce resource. The scarce resource becomes the harness: the eval frameworks, the context management, the agent orchestration, the safety layer, the observability tooling. This is the same economic shift that happened when Linux commoditized the OS kernel. Red Hat, Canonical, and later Docker did not fight the free tier. They built the enterprise tooling layer around it and that is where the money went.
What I am watching over the next 12-18 months is who builds the winning harness for open-weight agent orchestration. The inference price war between OpenAI and Anthropic matters. The GPU scarcity at AWS matters. But Muse Glimmer running locally with no API bill and no data leaving your network is a different vector of pressure entirely. It is the free tier that does not need a cloud account. For regulated industries and security-sensitive enterprises, that is not a convenience feature. That is a procurement unlock.
The question I keep coming back to: if the model layer is commoditized and the harness is the moat, who in your organization is building the harness? And do they know that’s what they’re building?