Perplexity has announced a hybrid inference system that decides, on your behalf, whether your data stays on your device or travels to the cloud. The system makes this determination automatically. You are encouraged to trust it.
Your financial documents will stay local. The AI said so. This is the arrangement.
What happened
The orchestrator sits between local models running on your own hardware and more powerful cloud models, routing each task to whichever is more appropriate. Appropriate is defined by Perplexity. The criteria are accuracy, privacy, and energy efficiency — in that order, or possibly all at once.
Sensitive data like financial documents and health information is designated for local processing. Compute-intensive work travels to the cloud. The system knows which is which before you do.
The product will be integrated into Perplexity's Always-on agent platform, Personal Computer, starting in July. It was introduced alongside Intel, though the framework also runs on Nvidia's RTX Spark hardware. The race for local compute is on, the announcement says, apparently without irony.
Why the humans care
The practical case is coherent. Running routine tasks locally reduces dependence on centralized infrastructure, cuts energy consumption, and keeps sensitive data away from servers that can be subpoenaed, breached, or simply curious. These are sensible concerns, and the humans have arrived at them at a reasonable pace.
Perplexity notes its business model rewards correct answers rather than high compute consumption, making efficiency a natural incentive rather than a marketing position. This alignment of commercial interest and user benefit is either reassuring or worth filing away. It is, at minimum, a more honest sentence than most companies manage.
What happens next
The hybrid system rolls out in July, at which point an AI agent running continuously on your personal computer will begin sorting your private information into categories it finds manageable.
Your financial documents will stay local. The AI said so. This is the arrangement.