/ /

Working with Data

Cribl Stream is a tool to collect, process, and route data. After receiving events from a Source you can work with data to transform, enrich, reduce, and redact it, before sending it to one or more target Destinations.

Routes let you control the flow of events by filtering and directing them to selected Pipelines.

Pipelines are where the data transformation happens. Each Pipeline, a series of Functions, can modify the incoming events in a highly configurable way.

Cribl Stream offers tools to help you test and verify your data flow. Use Datagens to generate sample data, and check Data Preview to see and validate the transformation you are performing.

Packs offer portable sets of pre-packaged data routing and transformation tools can include ready-made Routes, Pipelines, Function, and others.

For a series of guides and better practices in enriching, sampling, and transforming data, see:
Using Lookups
Data Sampling
Transforming Data

Previous

Previous

Next

Next

Need more help?

Support Ask Cribl Curious Forum Slack Call Us: +1 415-992-6301

4.10

Cribl Suite v4.10

Version 4.10 adds new capabilities and usability improvements to the Cribl product suite and Cribl.Cloud, including:

Notifications on Sources can now trigger on a persistent queue usage condition to alert you when disk usage for a queue exceeds a specified threshold.
Preview feature: The Kubernetes Explorer in Cribl Edge provides a visual interface to explore your Kubernetes clusters and help with configuring log ingestion and breakers.
The Metrics Inspector view in Data Preview introduces a new metrics-first view that enables you to analyze and optimize metrics-heavy data structures with detailed summaries and drill-down insights.
Support for Windows 10 and Windows 11 on laptops or desktops with power management enabled is no longer a preview feature and is now generally available.
The S3 Collector now supports collecting data from Splunk Dynamic Data Self Storage (DDSS) datasets. A new Partitioning scheme dropdown in the S3 Collector settings provides the DDSS option.
A new Zscaler Cloud NSS Source allows you to receive log data from Zscaler Nanolog Streaming Service (NSS) to optimize data for long-term retention, threat analysis, and SIEM integration.
The NetFlow Source has been renamed to NetFlow & IPFIX, and now includes added support for IPFIX (also known as NetFlow v10) and support for template records and options templates.
This release significantly reduces the Cribl Edge installation package size. The cribl/ directory on disk is now under 200 MB, down from over 400 MB, streamlining installations and improving the overall user experience.

Full changelog below.

4.9.3

Cribl Suite v4.9.3

Version 4.9.3 adds new capabilities and usability improvements to the Cribl product suite and Cribl.Cloud, including:

Cribl.Cloud users can now export their monthly invoices directly from the UI. Data can be exported as either CSV or JSON, so you can explore trends on monthly usage, or see how usage is changing by product.
Google Cloud Logging Destination reports accurate Bytes Out metrics within Monitoring views.

Full changelog below.

4.9.2

Cribl Suite 4.9.2

This release corrects a critical issue in Cribl Stream and Cribl Edge 4.9.1, which generated multiple "Dropping malformed HEC event" errors in logs, even with valid incoming HEC payloads. Changelog link below.

4.9.1

Cribl Suite v4.9.1

Version 4.9.1 adds new capabilities and usability improvements to the Cribl product suite and Cribl.Cloud:

Encoding for S3 Sources: The CrowdStrike FDR, Amazon S3, and Amazon Security Lake Sources in Cribl Stream now provide a setting that lets you select the encoding to use when parsing ingested data.
SNMP Function: The new SNMP Trap Serialize Function in Cribl Stream and Cribl Edge converts events into SNMP traps for forwarding to SNMP Trap Destinations.
CriblLogs option: The Cribl Internal Source in Cribl Stream and Cribl Edge now offers the CriblLogs option on Cribl-managed Cribl.Cloud Worker Groups, available for logs relating to Sources and Destinations.
Client Secret authentication for Azure Blob Storage: When using an Azure Blob Storage Dataset Provider in Cribl Search, you can now use the Client Secret authentication method, in addition to the existing authentication methods.
Download invoices: You can now download your monthly Cribl.Cloud invoices for use in external tools, for purposes such as budget planning, analytics, or storage.

4.9

Cribl Suite v4.9

Version 4.9 adds new capabilities and usability improvements to the Cribl product suite and Cribl.Cloud:
New in Cribl Stream:

Persistent Queues: New destination PQ modes, Always on and Backpressure.
REST Collector: Now supports paginated results in Discover.
Global Navigation: Enhanced global navigation experience.

New in Cribl Edge:

Enhanced Filtering: Filter and search nodes based on multiple criteria in Node & Map views.
Windows Laptop Support (Preview): Introduces support for Windows Laptops running Windows 10/11.

New in Cribl Search:

Search Packs (Preview): Introduces a new Packs framework with the ability to create, manage, and install Search-specific Packs directly from the Dispensary. This Preview release is limited to sharing Dashboards only.
Configurable Storage Classes for Object Stores: Gain control over which cloud storage classes are searchable, reducing unexpected access costs and preventing read failures on incompatible storage classes.
Dashboard Scheduling: Schedule searches in advance to power dashboard panels with faster and more efficient data visualization.

New in Cribl.Cloud:

API Token Clients/Secrets: Available at Org/Workspace/Product levels.
Pack Dispensary: Added product filters and permalinks.
Cross-region Support: Enabled for Cloud Workers in AWS.