Configuration

Collection Settings - What and Why?

Datorios provides a highly customizable data collection system to cater to various analysis needs, allowing users to streamline the collection of metrics, logs, and tracing data.

What Can You Collect?

• Tracing Data:
  • Record: Tracks individual data records passing through the pipeline.
  • State: Monitors the state information maintained by stateful operators.
  • Window: Observes windowed operations and their results.
• Metrics: Performance metrics for the job, task managers, and JVM.
• Logs: Categorized by severity levels: TRACE, DEBUG, INFO, WARNING, ERROR, and FATAL.