OfflineLLM: Private AI Chat

There is something seriously wrong with this app. No matter which model I download and use, no matter if I’m in advanced or beginner mode, no matter what question I ask, the AI just babbles incoherently. It seems to be obsessed with Tap Tap Revenge for some reason. I asked simply, what the capital of Brazil was to test it (using Llama 3.2 3B) and it returned a VERY long wall of incoherent text (I thought it was stuck in a loop for several minutes) but at the very end was a description of Tap Tap Revenge followed by a question: “What is the capital of New Zealand?” I may as well have flushed my three dollars down the toilet. Update to dev response: These ramblings are happening in beginner mode as well, where settings can’t be changed. Furthermore they are happening for me across three different types of devices. It seems like when you select a model that you’re possibly not actually using that model but the demo model; answers in the demo model are always nonsensical.

My AI chats just go off the rails. They ramble incoherently and i cant control them. Maybe i need assistance setting them up? But the demo alone just breaks completely its almost funny. So maybe ill change my review when the developer responds i really want to give this app a shot. Seems like a fantastic idea to be able to have your chat bot read pdfs before the chat to train on specific things. I really want it to work

The app is great for the price and has many editing features. Best app to use for automations in the Shortcuts app. I wish the dev will add custom pics for the LLM. I’d like to set my own picture for the model I’m talking to that’s all besides that this one takes the cake.