Distinct

​

Overview

• Deduplicating arrays of objects by a specific field
• Retaining the first occurrence of each unique value
• Reducing collection size before downstream processing

​

Command Type

​

Parameters

​

Usage Examples

​

Deduplicate by ID

{
  "command": "distinct",
  "params": {
    "key": "id"
  }
}

​

Deduplicate by Name

{
  "command": "distinct",
  "params": {
    "key": "name"
  }
}

​

Deduplicate by Event Type

{
  "command": "distinct",
  "params": {
    "key": "eventType"
  }
}

​

Common Use Cases

• Deduplication: Remove duplicate items from scraped data collections
• Data Normalization: Ensure unique records before processing or publishing
• Pre-filter Cleanup: Reduce redundant entries before downstream commands

​

Related Commands

• Filter - Filter items by value
• Array Join - Join deduplicated values
• Json Path - Extract fields from deduplicated output