Local LLM: MITHRIL

Bug Report: Model Persistence and Startup Errors (iPhone XS) App Version: Mithril (Local LLM) Device: iPhone XS iOS Version: [ ios 18.3.2] Issue Summary I am experiencing two main issues regarding model management and app startup: Redundant Download Prompt: After successfully importing and downloading a custom model, the app prompts me to download it again every time I select it. ExecuTorch Error: Every time the app opens, an "ExecuTorch error" appears, even though the model is already present on the device. Steps to Reproduce Import a custom model and complete the download process. Select the model for use. Observe the prompt asking to download the model again. (Current workaround: I close/force-quit the app to bypass this). Re-open the app and observe the "ExecuTorch error" notification upon startup. Expected Behavior The app should recognize that the model is already stored locally and load it immediately without re-triggering the download prompt. The app should launch without ExecuTorch errors if the model files are valid and present. Additional Notes Despite the error messages, the model does eventually work if I bypass the prompts. I am using an iPhone XS, so there may be specific optimizations or memory constraints related to older A12 Bionic hardware that are triggering these flags.

I’ve just started using the app and it’s working as described. There is one critical feature missing. It must have a way to quickly copy the generated text. Each request and response needs to be able to be copied easily. Preferably with a button or a shortcut. I will update my rating to 5 stars a fast as possible when this feature is added. If there is a stretch goal for this app I would like to be able to use text2image models as well. Great job, and keep up the great work.

This works better then I would expect on a phone. Would love to be able to host an openai style service on it with it.