Open-source ML and LLM validation

Build and run AI you can trust with Deepchecks

Deepchecks helps you test, validate and monitor machine learning and LLM systems across the full lifecycle, from raw data to production, with an open-source Python library and enterprise-ready tooling.

  • Higher model quality
  • Lower risk
  • Production confidence

What Is Deepchecks?

A comprehensive validation and testing toolkit for machine learning and generative AI systems.

Python notebook showing machine learning validation results and feature drift analysis

Deepchecks is a validation and testing platform for machine learning and generative AI systems. It helps teams make sure their AI is accurate, reliable, fair and ready for production by testing data and models at every stage of the lifecycle.

The core is an open-source Python package with ready-made checks and suites for tabular, NLP and computer vision data, while related products add CI collaboration, production monitoring and LLM evaluation.

Founded in 2019AGPL-3.0 open sourcePython package

Key Features of Deepchecks

Everything you need to validate models and data before and after deployment.

Comprehensive Validation

Data integrity, train-test and model evaluation suites in one package.

LLM Evaluation and Testing

Score generative AI apps for quality, grounding and safety.

Drift and Performance Monitoring

Track feature, label and prediction drift over time.

Bias and Fairness Checks

Find weak segments where results fall behind the average.

Rich Reports and Insights

Interactive notebook displays and shareable HTML reports.

Flexible and Open Source

AGPL-3.0 Python library you can customize and extend.

How Deepchecks Works

A simple, end-to-end workflow to test, validate and keep your AI systems reliable in production.

  1. 1

    Connect

    Load your data, models and LLM outputs into Deepchecks objects.

  2. 2

    Test and Evaluate

    Run automated checks and suites with pass or fail conditions.

  3. 3

    Analyse

    Read clear results, insights and root causes in reports.

  4. 4

    Monitor

    Keep watching performance and data quality in production.

What Deepchecks Does for AI Teams

Tools to test, evaluate and continuously monitor models and data, so teams can ship high-quality, responsible AI.

Deepchecks gives AI teams one consistent set of checks for every stage. The same logic that validates a dataset in a notebook can gate a CI build and later watch the deployed model, which keeps quality standards aligned from research to production.

  • Validate data and model quality
  • Evaluate LLMs with real-world checks
  • Detect issues such as drift, bias and performance drops
  • Monitor AI in production and take action early
Laptop screen listing Deepchecks data validation, model testing, LLM evaluation and continuous monitoring

Core Deepchecks Capabilities

Validation for classic machine learning, evaluation for LLM applications and monitoring once models go live.

Machine Learning Validation

Ensure your models are built on high-quality data and perform reliably. Run data checks, model tests and robustness evaluations before and after deployment.

Learn More
Deepchecks scatter chart with data quality, model performance and robustness checks passing

LLM Evaluation and AI Testing

Systematically evaluate and test LLMs for quality, factuality, safety and reliability. Use built-in and custom checks to align your models with real-world requirements.

Learn More
Deepchecks LLM evaluation with chatbot answers reviewed by passing checks

Continuous Monitoring

Keep your AI healthy in production with ongoing checks for data drift, performance changes and emerging risks. Get timely alerts and clear insights, so you can act fast.

Learn More
Deepchecks monitoring chart with alert bell, no data drift and stable performance

Download the Deepchecks Python Library

Get the open-source source code from GitHub or install the package straight from PyPI.

Deepchecks Open-Source Library

A flexible open-source library for testing, validating and monitoring ML models and data in Python. Use it in notebooks, CI/CD or your own workflows.

License: AGPL-3.0Language: Python 3Source: GitHub
pip install deepchecks -U --user
Use the official source

Get the code from the Deepchecks GitHub repository, PyPI or conda-forge only.

Isolate your environment

Install inside a virtual environment to avoid dependency conflicts.

Read release notes

Version details are published on GitHub releases and PyPI; review them before upgrading.

Why Choose Deepchecks?

A production-ready approach for teams that take AI quality and reliability seriously.

Trusted Quality

Catch issues early and ship models with confidence.

Enterprise Ready

Managed and self-hosted options built for real-world use.

Flexible and Open

Use the platform or the open-source library, your way.

Responsible AI

Evaluate fairness, safety and reliability with evidence.

Who Can Benefit from Deepchecks?

For any team that builds, deploys or manages AI systems.

ML and AI Teams

Build higher-quality, more reliable models before release.

Data Teams

Ensure data quality and catch integrity issues early.

MLOps Teams

Monitor, maintain and keep models healthy in production.

Product and Tech Leaders

Reduce risk and deliver responsible AI at scale.

Set Up Deepchecks in Minutes

Three short steps take you from installation to your first validation report.

  1. Install the package

    Run pip install deepchecks -U --user, or add extras such as deepchecks[nlp] and deepchecks[vision].

  2. Wrap your data

    Create Dataset objects with your label column and categorical features.

  3. Run a suite and read the report

    Run a built-in suite, view results with result.show() or save them as HTML.

Compatibility at a Glance

  • Python 3 packagePublished on PyPI and conda-forge; check PyPI for supported versions.
  • Notebooks and scriptsWorks in Jupyter-style notebooks and plain Python scripts.
  • CI pipelinesSuites with conditions can gate builds in continuous integration.
  • Tabular, NLP and visionBase package for tabular data, optional extras for text and images.

Deepchecks Pros and Cons

A balanced look at strengths and limitations before you adopt it.

Pros

  • Free open-source core under AGPL-3.0
  • Ready-made suites for tabular, NLP and vision data
  • Conditions turn checks into automated CI tests
  • Interactive notebook output plus HTML reports
  • Same checks reused from research to monitoring

Cons

  • AGPL-3.0 obligations need legal review for some products
  • Vision and NLP extras add heavier dependencies
  • Open-source monitoring covers one model per deployment
  • Thresholds need tuning to avoid noisy alerts

Fix Common Deepchecks Issues

Quick answers for the setup problems users run into most often.

Installation fails

Upgrade pip, use a clean virtual environment and run python -m pip install deepchecks so pip matches your interpreter.

Notebook cannot import the package

Your Jupyter kernel likely points to another environment. Install into that kernel's environment or switch kernels.

Dependency conflicts

Create a fresh environment, install Deepchecks first, then add other libraries and pin working versions.

Check names or parameters differ

Match the documentation version to your installed release, since names can change between versions.

Ready to build more reliable AI?

Start testing, validating and monitoring your models and LLMs with Deepchecks today.

Frequently Asked Questions

Quick answers about Deepchecks, its capabilities and how to get started.

Deepchecks is used to test and validate machine learning models and data. It runs checks for data integrity, train-test drift and model performance, and related products extend that work to production monitoring and LLM evaluation.

Yes. The Deepchecks testing package and the monitoring project are open source under the AGPL-3.0 license, with one enterprise directory in the monitoring repository covered by a commercial license.

The testing package includes modules for tabular data, natural language processing and computer vision, each with its own checks and suites.

A check tests one potential problem, such as feature drift. A suite runs an ordered list of checks together, optionally with conditions, and produces one combined report.

Conditions turn a check result into pass, warning or fail outcomes based on thresholds you choose, which makes checks usable as automated tests in pipelines.

Yes. Drift checks compare a reference dataset with newer data and score distribution changes for features, labels and predictions.

Deepchecks offers an LLM evaluation product for scoring generative AI applications on quality, grounding and safety, documented separately from the open-source testing library.

Validation suites can run in CI before deployment, and Deepchecks Monitoring tracks deployed models over time with dashboards and alerts.

Training libraries build models, while Deepchecks focuses on testing them: it inspects data and model behavior with ready-made checks instead of training anything itself.

Deepchecks was founded in 2019 by Philip Tannor (CEO) and Shir Chorev (CTO).