Launched this week
Snowglobe
Simulate real users to test your AI before launch
4.9•16 reviews•749 followers
Simulate real users to test your AI before launch
4.9•16 reviews•749 followers
Snowglobe is a simulation environment for LLM teams to test how their applications respond to real-world user behavior. Run full workflows through realistic scenarios, catch edge cases early, and confidently improve before deploying to production.
Snowglobe
🫡 Hi Hunters, I’m Shreya, co-founder of Snowglobe (by Guardrails)!
If you’ve built AI agents, you know how challenging it is to test them. How do you even begin formulating a test plan for a technology whose input space is infinite?
Most teams fall back on a small ‘golden’ dataset, maybe 50 to 100 hand-picked examples.
It takes ages to put together, and even then, it only covers the happy paths, missing the messy reality of real users.
That’s how you end up with an agent that’s perfect in development, but starts hallucinating, going off-topic, or breaking policies as soon as it meets real-world scenarios.
🔮 Snowglobe fixes this problem by creating a high fidelity simulation engine for conversational AI agents!
We build realistic personas and run them through thousands of simulated conversations with your AI agent BEFORE you go to production.
Our customers are already generating tens of thousands of simulated conversations with Snowglobe, allowing them to speed up what used to take weeks of manual scenario hand-crafting and catch potential issues before your users do.
🦾 Why we built this
Before Snowglobe, I spent years building self-driving cars at Apple. Weirdly enough, he challenge with LLMs is surprisingly similar to self-driving cars: huge input space, and high stakes when something fails.
In that world, we used high fidelity simulation engines to test cars in even the most risky, and rare scenarios.
Waymo, for example, logged 20+ million miles on real roads, but over 20+ BILLION in simulation before launch.
Our goal was simple - bring that same simulation-first mindset to AI agents, starting with AI chatbots.
💅 How we’re different
→ We perform rich persona modeling to ensure a lot realism and diversity in the scenarios we generate. This is not the same as asking ChatGPT to generate synthetic data for you, which then all sounds like the same ChatGPT-voice created them.
→ We simulate full conversations, not just one-off prompts.
→ We ground scenarios in your agent’s context so they’re relevant to your use case.
→ Unlike conventional redteaming tools, we test normal-user behaviors as well as edge cases.
→ You can export scenarios straight to 🤗 Hugging Face or your favorite eval & tracing tool.
🫶 Who is this for?
If you’re building a conversational AI agent and:
→ You’re stuck testing with a tiny dataset,
→ You want to create a dataset for finetuning your LLM, or
→ You’re spending too much time creating test sets manually, or
→ You want to run QA or pentesting before launch, or
You should give Snowglobe a try.
💸 Snowglobe.so is live and ready for use!
Product Hunt fam gets $25 worth of free simulated conversation generation with the code PH25 (in addition to the $25 worth of free credits on start).
We’ve poured a lot of engineering, research and, most importantly, love into this project.
We’re excited to see how we can help you test your chatbots better! 🙌
CoSupport AI
@shreya_rajpal very cool approach 👌
testing agents before they go live is huge - especially when real users have zero tolerance for hallucinations or off-brand replies. always curious to see how others tackle the “make it production-ready” challenge.
@shreya_rajpal Love the “pre-users before users” idea. Do you support persona libraries and replayable sessions for regressions?
Snowglobe
@shreya_rajpal @anwarlaksir Something we've been thinking about! Right now, we have a number of personas that can be used across simulations for the same app, but it's not as organized as a library (yet)
@shreya_rajpal @anwarlaksir @zayd_simjee would love to contribute to this product, sounds exciting!
Algorithmia
Congrats on the launch 🚀🚀
Tidyread
Congrats on the launch — Snowglobe's persona-first approach sounds promising! I like that you simulate full conversations rather than one-off prompts. Curious: how are personas generated and controlled — pure model-generated, human-curated templates, or can teams upload their own user profiles to match specific demographics/behaviors? Would love to know how editable and diverse the persona corpus is. 🤔
Snowglobe
@jaredl Hi Jared! Personas are totally model-generated, but we guide their generation using all the information you give us, including a description of what your bot does, what your knowledge base looks like, and historical chat data. You have some control over personas and messages via a "Simulation prompt" you can run on every step.
We aim to create personas that are diverse, yet realistic by paying special attention to things like styles, use cases, and goals.