Python Automation — Dataset Validator

A command-line utility for validating CSV datasets before annotation, evaluation, or analysis.

Features

• Checks required columns
• Detects blank values
• Identifies duplicate IDs
• Validates numeric score ranges
• Produces JSON reports
• Returns a non-zero exit code when validation fails
• Includes automated tests

Usage

python validate_dataset.py examples/sample.csv \
  --required id text score \
  --unique id \
  --numeric-range score 0 1

Write the report to a file:

python validate_dataset.py examples/sample.csv \
  --required id text score \
  --unique id \
  --numeric-range score 0 1 \
  --output validation-report.json

Run tests

python -m pip install -r requirements.txt
pytest