Can I Run This LLM ? - If I have this hardware, Can I run that LLM model ?
If I have this hardware, Can I run that LLM model ?
I have vibe coded a simple application to help you with just that.
It lets you chose the important parameters like unified memory for Mac or GPU + RAM for PC and then select the LLM (from hugging-face)