Imagine you launched a product in November 2025. Within four months, Jensen Huang had spotlighted it from the NVIDIA GTC stage, 188k (and counting) developers starred it on GitHub, and hundreds of fans show up to a lobster-themed conference dressed for the occasion.
The last point, I admit, is only relevant to OpenClaw. What this agent software has achieved in just a few months has astounded and unsettled the AI world.
Open source, freely available and community-built, is undoubtedly the weightier part of that story. But spend any time in the online chatter around OpenClaw and another theme surfaces: it runs on-device.
No cloud subscription required and no data leaving the building. Anyone can run an AI agent from their own hardware, entirely under their own control. Though local LLMs mean accepting some reduction in output quality, a trade-off the adoption numbers suggest many users are making deliberately.
This appetite has been building for years. What we are witnessing is the sweet spot where the hardware and models finally caught up with the demand. What it means for enterprise strategy, regulated industries, and the security of every endpoint in your organization is less obvious than it first appears.
THE SUBSTRATE CHANGED UNDER EVERYONE’S FEET
The reason this is happening now comes down to hardware. Neural processing units are standard on professional laptops, and AI models have become lean enough to run locally—no data center required. Gartner forecasts AI PCs will make up 55% of the market in 2026, which means the devices your procurement team bought last cycle almost certainly carry this capability, whether your AI strategy has caught up or not. The implication for business leaders is significant: sensitive, compliance-critical work can finally stay off the cloud entirely.
THE RULES ARE CHANGING
Working closely with the teams building these tools, I’ve seen what changes when the data residency problem is solved, particularly in Voice AI. Voice AI is one of the hardest (and most unforgiving) real-world AI tasks to run on-device. It includes accents, background noise, overlapping speakers, and variable recording conditions. For years, enterprise-grade accuracy required audio to leave the device. That was the trade-off every regulated industry accepted because there was no other option.
That trade-off is now gone. Leading on-device speech recognition now operates within 5% relative accuracy of cloud models. On modern hardware, these systems can process an hour of complex audio in approximately 55 seconds.
Before, every AI decision came with conditions: what the cloud permitted, what compliance allowed, what latency users would tolerate. On-device removed these constraints.
Once the ceiling lifts, several things change structurally.
- Privacy will become architectural, not contractual. The guarantee moves from a promise not to look to proof that the data never left the device.
- Compliance and auditing will shift. Without a centralized log, organizations need new frameworks for demonstrating what ran, where, and on whose authority.
- The cost structure will change at scale. Cloud compute is billed by usage. On-device, the hardware is already purchased. For large workforces, that converts a variable cost into a fixed one.
What this means is that on-device is no longer a contingency in the executive conversations I have. It is the strategy.
OPENCLAW’S OTHER LESSON
As Openclaw’s ecosystem grew, so did its attack surface. VirusTotal’s February 2026 research identified hundreds of actively malicious extensions across the skills marketplace. Snyk’s ToxicSkills analysis further found prompt-injection techniques in 36% of scanned skills, while 13.4% contained at least one critical-level security issue.
There were also multiple stories of major companies banning the framework entirely as governance concerns mounted.
On-device AI is dangerous. Risk depends on what the AI is doing. Speech recognition running locally presents a different threat model to an agent that can take automated actions. OpenClaw’s vulnerabilities were amplified by its ability to execute.
Moving intelligence to the endpoint changes the attack surface, and that demands a different kind of governance than most organizations have built.
This is solvable, because the governance frameworks built for cloud AI already give us a blueprint. The challenge now is adapting them early rather than retrofitting them after deployment.
THE LAST MILE
The era of AI as a distant service is ending. The alternative to the cloud finally works.
Intelligence is moving to where the work happens and where the decision cannot wait for a network round-trip. The industries that spent years accepting that trade-off no longer have to.
The hardware is already in your employees’ bags. If you haven’t begun defining your on-device AI strategy, this is the year to start—the shift is already underway.
Katy Wigdahl is the CEO at Speechmatics.
The final deadline for Fast Company’s Brands That Matter Awards is Friday, May 15, at 11:59 p.m. PT. Apply today.
