Featherless AI

Hello Product Hunters! 🪶 I'm super excited to launch Featherless.AI today! A platform that allows quick access to all the top 🦙 models you see in Hugging Face 🤗 today. From the 8B to the merged 11B's and Qwen-2 72B's I know it's daunting for folks to download and set up all these large models on GPUs to try them, one at a time. Also renting GPUs can be incredibly expensive as it's typically several dollars per hour. On the flip side, popular providers may not have the various finetune, or even weird model sizes that you would love to try. That's why we built featherless AI. To eventually download and provide access to **all** of hugging face public models. Making all the various open-source AI models more accessible. Starting with a simple $10 or $25 monthly plan, with unlimited usage (within the concurrency limit). So anyone can use it personally, across any model, without worrying about token pricing in their day-to-day usage. Also: as the team who also helps build open-source foundation models (hey RWKV folks!), we fully understand the concerns various folks have over data security and privacy. As such, featherless.ai has no logging of any of your message prompts and completion. Why? Because we are not interested in stealing your data to train our models. So use it any way you want to, dun let someone else tell you how you should use your AI models. 🪄 The magic behind it? At the heart of it, is a custom-built inference infrastructure, built by the team here from Recursal.AI : which was built to be able to dynamically hot-swap models in sub-seconds. Allowing us to rapidly autoscale and dynamically adjust our infrastructure based on what models are popular. Once we have the models downloaded into our cluster. This allows us to provide more models, where previous providers have been limited in ensuring every model hosted has a dedicated GPU for it. 💬 In summary 🏃‍♂️ Run any of over 450+ huggingface models 🛠️ OpenAI compatible API, use your existing tools or client 📈 Unlimited usage (within concurrent usage) 🦙 Starting at $10/month for <15B models 🦅 To $25/month for 72B models 🎁 Special for PH: Signup with a subscription, and add referral `hello+producthunt@featherless.ai` for $10 off your next month bill Feel free to ask me anything here on the product hunt launch! And give it a try with a free trial, which allows you to chat with the models (up to a limited amount of messages) at https://featherless.ai

Awesome. It's nice to be able to quickly try out and preview different llama models without having to deploy them on my own servers. Been meaning to the different variety of roleplay models for my dnd sessions. Are you planning to support other open-source models besides llama?

wow this is very cool! @eugene_cheah