Monitor Your Stream

This guide covers how to monitor and track your project’s performance, including item status, validation statistics, and overall project health indicators.

​

Project Status Monitoring

​

Project Status Toggle

The Project Status Toggle in the header allows you to control project execution:

​

Project Health Indicators

Monitor these key indicators to assess project health:

• Execution Status - Active/Inactive state
• Last Execution Time - When the project last ran
• Error Count - Number of failed executions
• Success Rate - Percentage of successful runs

​

Step Performance Statistics

Each step displays validation statistics in its header, providing real-time performance metrics:

​

Validation Statistics

Steps show three key metrics:

​

Step Header Information

Each step card displays:

• Step Name - Descriptive identifier
• Technology Badge - Primary technology used (HTTP, Browser, Android)
• Timeout - Maximum execution time (e.g., “120000 ms”)
• Validation Statistics - Performance metrics (valid/invalid/new counts)

​

Interpreting Statistics

Healthy Step Indicators:

• High valid count relative to invalid
• Consistent new item discovery
• Low timeout occurrences

Warning Signs:

• Increasing invalid count over time
• Zero new items for extended periods
• Frequent timeout errors
• Sudden drops in valid count

​

Project Items Monitoring

​

Project Items Tab

The Project Items tab provides comprehensive monitoring of extracted data: Features:

• View all items extracted by the project
• Monitor item status and metadata
• Track item creation and update timestamps
• Filter and search extracted items

Use Cases:

• Verify data extraction is working correctly
• Monitor data freshness
• Identify missing or duplicate items
• Export extracted data for analysis

​

Item Status Tracking

Monitor item status to understand data flow:

• New Items - Recently discovered items
• Updated Items - Items with refreshed data
• Processed Items - Items successfully sent to sinks
• Failed Items - Items that encountered errors

​

Testing & Validation

For detailed information on testing and validation, see the Debugging Your Project guide.

​

Performance Monitoring Best Practices

​

Regular Monitoring Checklist

• Check project status (Active/Inactive)
• Review step validation statistics
• Monitor invalid count trends
• Verify new item discovery rate
• Check Project Items tab for data flow
• Review timeout occurrences
• Test steps after configuration changes

​

Performance Optimization Tips

Improve Valid Count:

• Review and fix command configurations
• Update JSONPath queries for current data structure
• Verify HTTP request parameters
• Check data validation rules

Reduce Invalid Count:

• Identify patterns in invalid results
• Update parsing logic for edge cases
• Add error handling for missing data
• Validate data structure before processing

Increase New Item Discovery:

• Verify source data is updating
• Check for API or website changes
• Review filtering logic
• Ensure proper data extraction paths

​

Troubleshooting Performance Issues

For detailed troubleshooting steps and debugging techniques, see the Debugging Your Project guide.

​

Exporting Monitoring Data

​

Project Configuration Export

Export project configuration for analysis: Export Use Cases:

• Backup project configuration
• Share with team members
• Version control
• Performance analysis
• Troubleshooting support

​

Related Resources

• Creating Your First Project - Learn project setup
• Debugging Your Project - Testing and troubleshooting guide
• Project View User Guide - Complete interface documentation
• Command Configuration - Understand command settings