The foundation of any good data Pipeline is the ability to reliably onboard, simulate, and validate your data. Before applying complex transformations, you must ensure that your data is correctly shaped and that your processing logic behaves as intended under real-world conditions.

Cribl Stream has various tools that allow you to move from initial setup to a verified, production-ready state:

• Onboard Data
• Use Datagens to Simulate Live Data
• Create and Share Data Samples
• Data Sample Use Cases
  • Ingest-Time Sampling
  • Sample Logs
  • Access Logs: Apache, ELB, CDN, S3
  • Firewall Logs: VPC Flow Logs, Cisco ASA