YData

YData provides tools for improving data quality for AI, including the YData Fabric platform, the YData SDK, and the open-source ydata-profiling package (now renamed fg-data-profiling). The homepage states that YData has been acquired by KPMG.

What It Is

YData is a data-centric AI product family. YData Fabric combines a data catalog for profiling datasets, a synthetic data generator, and pipelines for data preparation. The YData SDK offers data profiling and synthetic data generation in Python. The homepage describes Fabric as Kubernetes-native and deployable on Azure Marketplace, AWS Marketplace, or on-premises infrastructure.

Profiling and Synthetic Data

The profiling package gives a one-line exploratory data analysis for pandas and Spark DataFrames. It infers column types and reports warnings and alerts for issues such as missing data, skewness, and high correlation. It also provides univariate and multivariate analysis, time-series and text analysis, file and image analysis, and dataset comparison. Reports export to HTML, JSON, or Jupyter widgets, and a command-line interface is available.

Fabric's synthetic data generation is described as producing data that mimics the statistical properties of real data. The site says this is meant to protect sensitive data, augment datasets, and support privacy compliance.

Pipelines and Integrations

Fabric pipelines let users clean and transform data, then version, compare, and track data flows. The profiling package documents integrations with Great Expectations, Streamlit, Dash, Panel, Airflow, Kedro, and IDEs such as PyCharm. Fabric Data Catalog connects to databases and storage systems such as Oracle, Snowflake, PostgreSQL, GCS, and S3.

Current Status

The ydata-profiling README states that the package has been renamed fg-data-profiling, with a migration guide. The old package will no longer receive updates or bug fixes. The vendor makes promotional claims on its site, such as being a #1 benchmark leader in synthetic data and productivity gains for data scientists.