FlakyTest.dev

Maker

📌

Hello Product Hunt! 👋 I've been working on a product that helps teams manage flaky tests. If you or your team ever feel like you need to spend more time re-running tests on pull requests, this product was made for you! The app's main feature is the 'mute' feature. It allows you to silence a flaky test without any code changes. A muted test continues to run on your CI, collecting errors, but it won't fail your entire build until it's unmuted (which happens automatically after a week by default). This way, your team can maintain control without being overwhelmed by forgotten skipped tests. Besides the mute feature, the product has all the other bells and whistles you'd expect: statistics, graphs, breakdown per test, error logs, etc. I've also tried to make the setup as simple as possible, so all you need to do is install a package and add an environment variable in your CI. I focused on Python 🐍 for the initial launch, but I'll add support for other languages and frameworks based on feedback. This is my first product launch on Product Hunt, so I appreciate any feedback, thank you 🙏

Report

Share

1yr ago

Dimitrie Baitanciuc

Brizy

Great product, looking straight!

Report

Share

1yr ago

Anže Pečar

FlakyTest.dev

Maker

@dimitrie_baitanciuc Thank you!

Report

Share

1yr ago

André J

Does it work as apart of a GitHub actions pipeline?

Report

Share

1yr ago

Anže Pečar

FlakyTest.dev

Maker

@sentry_co Hey, yes, it does It should run in any CI just as long as you have the flakytest plugin pip package installed and the FLAKYTEST_SECRET_TOKEN env variable set. I haven't gotten around to writing instructions for other CI systems yet, but if you let me know what you are using I'll make sure to prioritize writing docs for that!

Report

Share

1yr ago

André J

@anze3db I think the most common use case would be Github actions. I use that for my remote test pipeline. Amongst others

Report

Share

1yr ago

Anže Pečar

FlakyTest.dev

Maker

@sentry_co I think I misread your original comment. I thought you were asking if it works anywhere else besides GitHub Actions. I do have a doc explaining how to set up GitHub Actions: https://flakytest.dev/ci/ since yes, I think it's the most common option these days!

Report

Share

1yr ago

FlakyTest.dev

How Python teams fix flaky tests

Do you use FlakyTest.dev?