Subscribe
Sign in
Launched on November 28th, 2023
Launched on August 8th, 2022
Continuously validate LLM-based applications including LLM hallucinations, performance metrics, and potential pitfalls throughout the entire lifecycle from pre-deployment and internal experimentation to production.๐
Deepchecks Monitoring takes the open source testing experience all the way to production: enabling you to send data over time, explore system status and receive alerts on problems that arise over time.
Having had the privilege of contributing to Deepchecks' initial presentation design, I've witnessed first-hand the remarkable journey of this tool. Today, Deepchecks stands as a comprehensive solution for continuous ML validation, truly revolutionizing the field. The open-source core of Deepchecks offers an extensive suite of tools for testing and monitoring ML models. This functionality is invaluable to data scientists and ML engineers. The recent expansion to include both testing and monitoring is a testament to Deepchecks' commitment to meet the ever-evolving needs of the ML community. Deepchecks Hub is another impressive feature that deserves mention. It brings together the validation of multiple models in a managed and secure setting, accommodating everything from research to production. The hub's functionality includes scalable deployment options, the ability to validate multiple models in parallel, security and access management features, and support, making it a one-stop solution for commercial settings. From a product designer's perspective, I can't help but appreciate the intuitive user interface that Deepchecks has designed. The platform is easy to navigate with a logical layout that makes complex tasks feel manageable. The process of installing and setting up Deepchecks is refreshingly simple, requiring only a few lines of code. One of the standout features of Deepchecks is its broad support for different data types, including tabular data, computer vision, and NLP, throughout the model and data lifecycle. This flexibility makes it a versatile tool that can cater to a wide range of ML projects. Deepchecks' commitment to the open-source community is commendable. It fosters a collaborative environment that encourages continuous improvement and innovation. Regular updates, blog posts, and newsletters keep users informed about the latest industry trends, while the availability of a demo and comprehensive documentation make it easy for newcomers to get started. In conclusion, Deepchecks is an exceptional product that is transforming the landscape of ML validation. As someone who had a hand in its early stages, I am proud to see how far it has come and eagerly anticipate its future contributions to the field. I wholeheartedly recommend Deepchecks to anyone involved in machine learning, whether you're a seasoned data scientist, an ML engineer, or a newcomer to the field. This is a product that truly delivers on its promise, providing everything you need for continuous ML validation.
Great product that allows me to better monitor my models very efficiently and with relatively low touch
The seamless augmentation of DeepChecks offering from the development stage of the data acquiring stage to Model Building ends with lean production monitoring. Continues QA and Validation.
