Hey Product Hunt 👋 Emma and Chris here from Velvet. We built an AI gateway to warehouse OpenAI and Anthropic requests to your database. Engineers use Velvet logs to analyze usage and costs, evaluate models, and generate datasets.

Our first product was an AI SQL editor. It worked really well, but we had limited insights into what happened between our app and OpenAI. We started storing requests to our database, giving us the ability to query data directly. It gave us so much more control over developing our AI features.

We didn’t think of it as a product until one of our customers (Find AI) asked to use it. We warehoused over 3 million requests for them in the first week, logging up to 1,500 requests per second during their launch. Now we have many startups using Velvet daily for caching, evaluations, and analysis of opaque endpoints like the Batch API.

Try a sandbox demo → usevelvet.com/sandbox (no signup needed)

Read the docs → docs.usevelvet.com

Get started with two lines of code 🧑🏻‍💻

It's easy to get started! Once set up, we warehouse every request to your database.

Requests are formatted as JSON. You can include custom metadata in the header - like user ID, org ID, model ID, and version ID. This means you can run complex SQL queries unique to your app. Granularly calculate costs, evaluate new models, or identify datasets for fine-tuning.

We'd love to hear from you! Email team@usevelvet.com with any feedback or questions.

Watch a demo video to learn more.

Congratulations on launch! Our company Find AI has been an early customer of the AI gateway, and it's been a game-changer for our engineering team to interact with OpenAI. Here's some of the things we do with the millions of requests we warehouse weekly with Velvet: - Cost analysis: What's AI spend per user, per search, for logged out users, and in prod vs. development? - Debugging: When a query does something weird, trace it back to the OpenAI call. We traced one query that occasionally returned gibberish, and realized that the temperature was just too high. - Caching: particularly use this on smoke tests, so that we can actually query OpenAI if our prompt/model/etc changes to verify expected behavior, but skip paying money if things are the same - Testing model upgrades: This week we've been exporting data of some models in gpt-4o, then re-running the exact queries against gpt-4o-mini. To our surprise, a couple of our classification queries had 100% the same accuracy on the mini model, so we could immediately switch and save money.

Congrats for the launch and thank you, we are happy users of Velvet, it's not only very simple to set up and use but also highly reliable and very well designed. Kudos team 🙌

I see three killer features: 1. Integration in 2 lines means I can try it w/o much work 2. Hosting my own DB (obviously important) 3. Caching out of the box The third feature is crazy important for nearly everyone building with LLMs. I can't think of a reason not to try Velvet - congrats on the launch, really excited to see where this goes

The Velvet team is stellar--I've been watching them constantly improve the product for the better part of a year by eliciting and responding (swiftly) to feedback.

I'm usually working with AI companies that use LLMs to improve their models; I'll tell them to check out Velvet. Seems like useful tool for brining transparency to the workflow of engineers. Congrats on the launch @emmalawler24 🤠

Hey Emma and Chris, Does using Velvet as a proxy introduce any noticeable latency? For companies concerned about data security, what measures are in place to ensure the safety of the stored requests? Congrats on the launch!

Congratulations on the launch! Love how simple you’ve made Velvet to install and scale!

Velvet’s approach to warehousing AI request is very promising. This feature could really streamline how we analyze and optimize our AI models.

Congrats on the launch @emmalawler24 !! As a user of Velvet, I can't think of a better tool for us to monitor LLM usage.

Congrats on the launch! Making our LLM requests actually queryable has been on our wishlist and isn't quite satisfied by logging/observability providers we know about. Excited to test it out 🔥

I noticed the demo video link seems to be broken . It would be great to see it working to get a full picture of Velvet’s capabilities.

Velvet looks really useful. Just took a quick peek, and it's wonderful. Definitely gonna give it a shot on my next project.

Sounds like a super useful tool,@emmalawler! Love how you guys built something to help manage AI requests and analyze data better. Just checked it out and it looks promising. Congrats on the launch!

Congrats on the launch! I'm sorry I can't give you much feedback on this since the website's not loading for me.

Happy launching. Don't know much about coding but the hugs in the company admire your work!! Everyone's repeating "with two lines"😃

Awesome to see Velvet’s innovative approach to warehousing AI requests! 🎉 The ability to analyze usage and costs while owning your data is a game-changer for developers. The integration seems seamless with just two lines of code! Excited to see how this evolves and brings more insights to the AI space. Shoutout to @emmalawler24 and Chris for building something so valuable for startups! Definitely going to check out the sandbox demo!

This is a game changer, Emma and Chris! Velvet simplifies AI request management significantly. The insights from warehousing those requests will empower developers to optimize their models and costs effectively. Excited to see where this goes! 👏

Great Idea to Analyze data better

I found it super easy to set up, just a couple of lines of code and I'm good to go.