The cost of using advanced AI models, like GPT-4, dropped dramatically by 1,000 times in just two years.
This rapid price reduction is much faster than for other foundational technologies such as the internet or computing.
Despite widespread access, integrating AI effectively into businesses faces significant organizational challenges.
These challenges include redesigning workflows, retraining staff, and navigating new regulations.
Such organizational adjustments are now the main hurdle to fully realizing AI's economic benefits.
Examples
- Factories took a generation to reorganize around electric motors after electricity became affordable.
- Productivity gains from information technology lagged adoption by over a decade due to workflow redesigns.
- Hospitals must redesign clinical workflows and obtain regulatory clearance for AI diagnostic tools.
- Law firms need to develop quality-control procedures and navigate professional responsibility guidance for AI.
- These adjustments are often slower and harder to resolve than the technology's initial adoption.
It's certainly true that the GPT-4 inference price collapse is impressive, dropping 1,000-fold in just two years, but seeing this as the primary driver for a stable group of frontier AI model creators feels like a simplified view of a more complex system.
While cheaper inference might reduce a barrier to using AI, the real bottleneck for those creators isn't just the raw computation cost, but the massive organisational adjustment costs and expertise required to build and integrate these models effectively.
Think of it like buying cheap, high-powered engines: if you don't have the engineers, the factory lines, and the distribution network to use them, the price drop alone won't create new car manufacturers overnight.
The feedback loop here is slower and more intricate; until organisations can fully absorb and leverage these tools, the creator market remains constrained by human and systemic factors, not solely by technology cost.