Skip to main content
Validation commands check that the data flowing through your scraper pipeline meets expected conditions. When a validation fails, the command throws an error and halts execution, preventing bad data from reaching downstream steps.

​
Overview

Validation commands provide functionality for:
  • Checking that required strings are present in the data
  • Checking that forbidden strings are absent from the data
  • Combining multiple checks with OR or AND logic

​
Available Commands

Command Validation

Validate whether specific strings are present in or absent from data

​
Common Use Cases

  • Response Guard: Confirm a success token exists before parsing an HTTP response
  • Error Detection: Halt a pipeline early if an error string is detected
  • Completeness Check: Ensure all required field names are present in the raw payload