Athina - Build, test and monitor AI apps and agents

Hey PH, I'm Shiv, a co-founder of Athina AI. Building GenAI applications is a lot of hard work. Most teams are able to build prototypes quickly, but end up spending months getting their AI to work well in production. A big part of the problem is a lack of good tooling. We've seen countless teams using scripts, python notebooks, spreadsheets, and even google docs to work with their prompts and datasets. But these tools are not designed for building production-ready AI. 😥 Which is why many teams including unicorns like Perplexity, Meesho, and Doximity are choosing to use Athina... 🙌 We've spent the last 1.5 years building a comprehensive platform for teams building production-grade AI features. Athina is an end-to-end LLM development platform that teams can use across the AI development lifecycle: ✅ Prompt Management: Manage, iterate, test and version control prompts ✅ Flows: Build powerful multi-step AI workflows in a notebook ✅ Datasets: Work with your datasets in a powerful spreadsheet-like UI ✅ Evaluation: Run evals on uploaded datasets, in CI / CD, or automatically on traces ✅ Experiments: Run experiments to compare outputs from different prompts / models ✅ Annotation: Have humans annotate your datasets for RLHF or human evaluation. ✅ Observability: Log traces, run evals continuously in production and monitor for regressions And here's the best part – Athina is designed for both non-technical AND technical users to collaborate. So your entire team can work together to build AI features without being bottlenecked on engineers to build flows or run experiments. No-code + SDK! 🔥 ----- 🟠 We're backed by Y Combinator and have been working with some of the best AI teams in the world over the last year. We're really excited to finally bring this platform to Product Hunt for everyone! 🌐 Website: https://athina.ai 🗓️ If you're interested in learning more, or seeing a demo, please feel free to get in touch with us: https://cal.com/shiv-athina/30min

The LLM platform every product team needs - congratulations guys!!!

Looks insanely cool, might even be able to use this for a current project we're running - I have to say, big fan of the name too - That was what initially caught my eye.

Athina has a broad set of powerful tools. We use it from prototyping a new idea, to refining it, to monitoring it production.

Awesome team! Highly recommend getting a demo with @shivsak

We use portkey for LLM monitoring and prompt management - how does this companre?

Great job guys! We've been using Athina and it's a MUST have tool in your AI team!

Congratulations on the launch! We've been using Athina AI and it's been saving us so much time with our annotations. Previously, we'd have to curate our datasets amongst different annotators on Google Sheets and it's a massively painful process. With Athina, we're able to curate our datasets (with inter-annotator agreements) much more easily and create much higher quality Evals.

This is a game-changer! Great job, guys!

It's a great product: comprehensive and user-friendly. We initially used Athina primarily for logging, but it has become increasingly integrated into our model development and evaluation process.

Very exciting! Highly recommend, Shiv and team are great.

Athina is by far the best AI development platform I have ever used. If you wanna build, test and improve AI systems, Athina is the right product.

Love the platform and the name's great too 🔥

Congratulations @shivsak on the launch, We are using Athina at Richpanel to build evals for our Customer Support AI Agents and already love the product. I would recommend it to everyone who wants to build reliably with LMMs.

Me and my team reviewed 10+ frameworks for LLM experimentation and observability. We ended up going with Athina and are very happy with our choice! The experimentation suite is really flexible and integrating our applications and existing observability stack was really smooth. Big + for exposing observability data via API!

Just came across this, and looks super interesting! How does this compare to Braintrust?

I recommend Athina because it is a powerful platform for developing, testing, and monitoring AI applications. It provides great tools for teams that work with large language models (LLMs).

Great job guys! can i use it for on chain agents also ?

Have been using Athina from a couple of months. I strongly believe LLM applications in production needs a strong observability and athina fits the bill. Also, seamless prototyping with prompts is also a great feature. Looking forward for a longer collaboration :)

Athina stands out as the most exceptional AI development platform I’ve ever encountered. Whether you’re looking to build, test, or refine AI systems, Athina is the ideal choice.