Perplexity partners with Nvidia to launch Portable Computer, a fully local AI agent with zero token costs
Perplexity’s new Portable Computer lets its “Computer” agent run entirely on‑premise using Nvidia hardware—specifically Nvidia DGX Spark desktops or Linux machines equipped with Nvidia RTX GPUs—by loading a 27‑billion‑parameter Qwen model locally. The full agent stack (model, harness, inference engine, tools, and security sandbox) is bundled into a single app, eliminating cloud token costs and keeping data on the device. Engineers can now prototype multi‑step AI workflows (e.g., document review) without provisioning separate inference servers or incurring usage fees.
⚡ Key Takeaways
- 27‑billion‑parameter Qwen model runs at full GPU utilization on a DGX Spark.
- Portable Computer bundles the agent harness, inference engine, tools, and sandbox into one installable app.
- Zero cloud billing credits are consumed; all work stays local unless the user explicitly permits a cloud step.
- The app targets Nvidia RTX‑GPU‑enabled Linux machines as well as DGX Spark desktops.
- If a task requires a more powerful frontier model, the system will request permission before sending that step to the cloud.
Shipping a complete, locally‑executed AI agent removes data‑privacy concerns and eliminates per‑token costs, enabling production teams to run sophisticated multi‑step workflows on existing Nvidia hardware without building a custom stack.
✅ Practical Steps
- Install Portable Computer on a DGX Spark or a Linux machine with Nvidia RTX GPUs to run the bundled local AI agent stack.
Want the full story? Read the original article.
Read on VentureBeat AI ↗