BonzAI - Local AI Agent

This app is seriously slept on. It can handle documents and images. It allows the use of custom .GGUF models and supports MCP tools. It has web search, current time, weather, and location built in and you can add your own MCP servers with an API key or Oauth 2.x. If you have an API key for a cloud model such as Claude or ChatGPT you can import that and use it as well. While it’s not LM Studio it contains nearly everything you could need in a mobile context. You can customize hyperparameters, use KV Cache quantization, and support context lengths to whatever your device capabilities are. You can even adjust the amount of tokens used for image analysis which is super useful. I have been able to run Qwen 3.5 4B (Q5_K_M) with VL projector disabled at 80k context length with Q5_1 KV Cache quantization… on an iPhone 17 Pro. The app only crashes on me if I try to do something insane such as run Qwen 3.5 9B at 48k context. The app works great on Mac as well and it’s intuitive enough that my mom is able to use it. If the app is crashing on you choose a smaller model or upgrade your iPhone 11; it literally came out last decade.

I have tried countless apps in the app store to find one that lets me use Prism ML’s Bonzai with full web access. Im not sure what sort of dark magic this app is using, but the quality of the web searches and the flawless integration of my beloved Bonzai 8B has currently replaced my entire habit of going to Google for web searches. This has replaced the need for Google web search, GPT for random questions, and sometimes even shopping. The weather and clock features are excellent too. Simply asking my model about my location’s weather gives highly accurate pulls every time (with the right settings and setup of course). As far as integration goes, I have yet to find an app that is compatible with Bonsai (fully) AND uses the correct settings its makers recommended + full web search and much more.

Works fine sometimes, but quite often takes up 100% of the CPU and then I have to kill the session. Please fix this!