gitmyhub

pocketpal-ai

TypeScript ★ 7.4k updated 9h ago

An app that brings language models directly to your phone.

A free mobile app for iOS and Android that lets you download and chat with AI language models entirely on your device, with no internet needed and no data leaving your phone.

TypeScriptReact NativeiOSAndroidsetup: easycomplexity 2/5

PocketPal AI is a mobile app that runs AI language models directly on your phone, with no internet connection required. It works on both iOS and Android. All processing happens on the device itself, so your conversations and data never leave your phone or reach any external server. The only information that can exit your device is benchmark data you choose to share or feedback you submit voluntarily.

The app lets you download small language models from a built-in catalog that includes options like Phi, Gemma 2, Qwen, and Danube. You pick a model, download it, load it into memory, and then chat with it. You can swap between models at any time, adjust settings like the system prompt and temperature, and retry a message using a different model for comparison. Real-time performance metrics show you how fast the model is responding, measured in tokens per second.

A feature called Pals lets you create distinct AI personalities with custom settings. You might build an assistant focused on cooking recipes, or a roleplay character with a specific location and role. The Pals picker in the chat screen makes switching between these personalities quick. The app can also generate a system prompt for a new Pal using AI, so you do not need to write one from scratch.

The benchmarking tool measures how fast a given model runs on your specific device and shows memory usage alongside speed metrics. Results can optionally be submitted to a public leaderboard where users compare phone performance across different devices.

PocketPal AI is available as a free download on the App Store and Google Play. The repository is open source, and the README includes setup instructions for developers who want to build or contribute to the project.

Where it fits