DQ Validator Module API

The DQ Validator module provides comprehensive in-memory data quality validation.

• Core Classes API
  • Validator
  • ValidationRule
  • BaseCheck
  • ValidationError
  • Data Quality Dimensions
  • Usage Examples
• Metadata API
  • AssetMetadata
  • ColumnMetadata
  • DataType
  • DataTypeEnum
  • Usage Examples
• Validation Checks API
  • LengthCheck
  • ValidValuesCheck
  • ComparisonCheck
  • CaseCheck
  • CompletenessCheck
  • RangeCheck
  • RegexCheck
  • FormatCheck
  • DataTypeCheck
  • Usage Examples
• DataFrame Integration API
  • Base Integration
  • Pandas Integration
  • PySpark Integration
  • Usage Examples
• REST API Providers
  • Configuration
  • Base Provider
  • Glossary Provider
  • CAMS Provider
  • Assets Provider
  • Dimensions Provider
  • Checks Provider
  • Issues Provider
  • DQ Search Provider
  • Data Models
  • Usage Examples
• Results API
  • ValidationResult
  • ValidationResultConsolidated
  • Issue Reporting
  • Usage Examples

Overview

The DQ Validator module includes:

• Core Classes - Validator, ValidationRule, BaseCheck

• Metadata - AssetMetadata, ColumnMetadata, DataType

• Validation Checks - Nine comprehensive check types

• DataFrame Integration - Pandas and PySpark validators

• REST API Providers - IBM Cloud Pak for Data integration

• Result Consolidation - Result aggregation and analysis

Module Organization

The module is organized into several sub-packages:

• dq_validator - Core validation engine

• dq_validator.checks - Validation check implementations

• dq_validator.integrations - DataFrame validators

• dq_validator.provider - REST API providers