3sparks Chat

Great job overall. However, a few things are really annoying. The default token limit is too small. I’d like to set the default per connection. Another annoying one is that Gemini doesn’t use grounding. Please enable Search grounding for Gemini models. The last annoying thing is that there’s no iOS Live Activity corresponding to running queries. It’s really annoying to have to keep the app open for the query to not be interrupted.

I don't use this app, I wasted my money on it. Buy LATENT CHAT if you want backgrounding for your LLM. This developer acts like her cares by adding useless functionality like web to RAG, but u can just download a pdf and rag that in latent chat so it does the same thing, BUT as soon as you leave this app your prompt and the response WILL ERASE WHILE STREAMING. This is not ideal for large contexts and slow LLM responses, and this guy thought he could jam in vision enabled (analyze image input) without any repercussions. So that image adding function is basically useless if you expect a long response for an LLM that utilizes your full GPU offload, and if you accidentally leave the app you can kiss your maximum effort prompt you worked on prompt bye bye! 👋 TL;DR: I see right through this gimmicky update, its not worth it until he adds backgrounding while streaming responses. Otherwise it's ok if you just need very basic text response where you are stuck inside the app and cannot leave. 😘yw for the feedback😘

This is the only app of this kind that I can find for iOS to connect to an LM Studio server for local LLM chats. It connected easily, and I was able to be up and running in just a few minutes. It seems to be a bit slower than running locally, but that might have to do with the models I’m running more than the app itself. I also had some issues with garbled responses from certain models, but I have some that work perfectly so there might just be some incompatibilities somewhere in my settings. Overall it’s a great app though, and I’m always happy to see something that doesn’t require any kind of ongoing subscription.