An easy to use, all-in-one desktop application to run large language models (like Llama) locally, on your computer.

Hello everyone, I've been missing all-in-one, simple-to-use GUI app for running language models locally so I made one. It's almost 3 months since I've started with this and I've recently added experimental support for Windows so I think the time has come and without any further marketing gibberish, let me just share this project with you :) Happy to hear any kind of feedback, really.

Awesome! Nice product! Is it possible to install a new model on my own? for example, I want to try some models from Huggingface.

@naoto_shibata_morph yes, just download the models somewhere and then go to the settings and click on the import button. by default it will look in the downloads folder but you can change that

Isn't this already doable with llama app or something like that?

@kingromstar Yes, there is llama.cpp if you don't mind compiling it yourself, then there's Ollama which is small layer of top of llama.cpp, and it's a command-line app, so no GUI. And then there are all-in-one GUI apps like this one, LM Studio and Faraday. I am not aware of any other ones currently. LM Studio is great and has many toggles if you like to play with all the possibilities, this is way more simple and straight to the point. Faraday is similar in spirit to this one but more focused on role-playing. This is something in between, and I'm working on automation feature which will make it more a productivity tool.

Ava PLS

Desktop app for running LLMs locally

Desktop app for running LLMs locally

Ava PLS

Desktop app for running LLMs locally

Desktop app for running LLMs locally

Do you use Ava PLS?

Do you use Ava PLS?

You might also like