These docs are for Cribl Edge 4.9 and are no longer actively maintained.
See the latest version (4.13).
Deployment Planning
When you’re planning an Edge deployment, consider these key factors:
- The amount of data (metrics, logs, custom command outputs, and so on) that you plan for Edge to collect from the endpoint and ingest per unit of time. For example, MB/s or GB/day.
- The amount of processing that will happen on incoming data. For example, are there a lot of transformations, regex extractions, parsing functions, field obfuscations, and so on?
- Routing and/or cloning: Is most data going to a single Destination, or is it being cloned and routed to multiple places? This is important, because Destination-specific serialization tends to be relatively expensive.
- Deploying onto servers with no internet access: If you plan to deploy Edge Nodes on air-gapped on-prem servers (servers with no internet access), you must ensure that every Edge Node can communicate with a Leader that is also on-prem (that is, not in Cribl.Cloud).
Types of Deployment
- Cribl Cloud: Quickly launch a Cribl-managed deployment of the combined Cribl applications suite (Edge, Stream, and Search). In Cribl.Cloud, Cribl provision and manages all infrastructure on your behalf.
Managed Edge: A central Leader Node controls, manages, and pushes configuration updates to all managed Edge Nodes. This deployment type provides a centralized view for multiple Edge instances, which is beneficial for large-scale deployments of Cribl Edge.
Single-instance: Single-instance Edge Nodes operate without a central Leader. You will configure and manage Edge Nodes locally. Single-instance Edge is suitable for smaller deployments or environments with limited network connectivity.
When you have a large number of Edge Nodes to manage, you can use Fleets to group Nodes together and apply configurations centrally. Use Fleet Management to accommodate increased load. See Add and Update Edge Nodes to streamline deploying Edge Nodes via scripting.
System Requirements
Edge Nodes should have sufficient CPU, RAM, network, and storage capacity to handle your specific workload. It’s very important to test this before deploying to production.
Minimum Requirements for Edge Nodes
Operating System | Minimum Requirements |
---|---|
Linux (RedHat, CentOS, Ubuntu, AWS Linux, Suse) | ~1Ghz processor, 512MB RAM, 5GB free disk space (more if persistent queuing is enabled on Edge Nodes) |
Windows Server (64-bit), Windows 10 and Windows 11 Workstations (See, Windows Requirements for details) | ~1Ghz processor, 512MB RAM, 5GB free disk space |
Edge Node sizing depends on specific workload requirements and organizational constraints. While minimum specifications are provided, optimal configurations vary widely. Consider data volume, types, processing needs, and organizational standards when selecting hardware.
See also Leader Node Requirements in Cribl Stream documentation.
Linux Requirements
- 64-bit kernel >= 3.10 and glibc >= 2.17, OpenSSL >= 3.0.
- SELinux: Enforcing mode is supported, but not required.
Tested Platforms (Linux)
OS (Intel Processors):
- Ubuntu 16.04+, Debian 9+, RHEL 8+, CentOS 8+, SUSE Linux Enterprise Server 12+, Amazon Linux 2014.03+.
OS (ARM64 Processors):
- Ubuntu (14.04, 16.04, 18.04, and 20.04), CentOS (8. 9), and Amazon Linux 2.
As of October 16, 2024, Cribl has deprecated support for the CentOS Linux 7 distro, which reached its end of life on June 30, 2024
Windows Requirements
Cribl Edge supports these versions of Windows:
Version | Workstation Type | Notes |
---|---|---|
Windows 10 and 11 | Always-on network connection to the Leader. | Support for Windows workstations that do not have power management features enabled (sleep or hibernate). |
Windows 10 and 11 | (Preview Feature) Laptop or desktop with power management enabled. | Keep these things in mind when deploying Cribl Edge on Windows 10 and 11 workstations that are not always on:
|
Windows Server 2016 Windows Server 2019 Windows Server 2022 | Any | N/A |
Browser Support
- Chrome, Firefox, Safari, and Microsoft Edge: the five most-recent versions.
Leader Scalability
Our System Requirements suffice for Leaders handling up to 10,000 Edge Nodes. To support more than 10,000 Nodes, see our Planning Large-Scale Deployments of Cribl Edge guide.
Leader/Edge Nodes Compatibility
Leaders on v.4.2.x are compatible with Edge Nodes on v.4.1.2, v.4.1.3, and later. Due to a security update, Edge Nodes running on v.4.0.4 cannot receive configurations from v.4.2.x Leaders. For details, see Leader and Edge Nodes Compatiblity.
Disable SNI Routing for Firewalls/Web Proxies
If you have a proxy or firewall deployed between your Edge Nodes and the Leader, a new setting allows you to disable SNI routing for specific Fleets. For details, Disable SNI Routing for Firewalls/Web Proxies.
About Licensing
- Free: Entitles users to manage up to 100 Edge Nodes, in a single Fleet, and ingest up to 1TB/day.
- Enterprise: Entitles users to manage unlimited Edge Nodes, across unlimited Fleets and ingest up to its rated volume.
Permissions and Rights
You do not need elevated privileges to install Edge. However, you will need:
- Administrator (or equivalent) rights in order to enable Edge to start on boot.
- Sufficient rights to access the resources that need monitoring – files, metrics, etc.
Performance Considerations
As with most data-collection and -processing applications, Cribl Edge’s expected resource utilization will be proportional to the data volume and type of processing. For instance, a Function that adds a static field on an event will perform faster than one that applies a regex to find and replace a string.
- Processing performance is proportional to CPU clock speed.
- All processing happens in-memory.
- Processing does not require significant disk allocation.
Thinking about your planned Edge deployment as a whole, it’s critical to consider cardinality: how many Fleets, of what size, will send metrics to a given Leader. In a very low-cardinality deployment, a Leader Node might aggregate metrics from one small Fleet; in a very high-cardinality deployment, a Leader Node might aggregate metrics from many large Fleets.
Too many Edge Nodes sending too many metrics can degrade Leader performance and/or integrity. By carefully choosing what metrics each Fleet sends to its Leader Node, you can ensure that you collect the metrics most important to you, within the limits of the Leader’s capacity to process them.
As part of your deployment planning, decide which of the following four sets of metrics each Fleet in your deployment will send to its Leader Node:
- Minimal: Limited to metrics for events and bytes in and out. Recommended for high-cardinality deployments.
- Basic (the default set): All the metrics required to display all monitoring data available in the Edge UI. Contains all the metrics in the Minimal set, and more.
- All: All metrics, sent without filtering.
- Custom: Only metrics that match a JavaScript expression that you define.
For a listing of the metrics each set provides, see Controlling Metrics in Cribl Edge.
How Edge Works with AppScope
AppScope is an Open Source utility from Cribl that can send events, metrics, and/or payloads from a process or application to an AppScope Source on Edge.
Here’s what to keep in mind when you plan to use Edge and AppScope together:
- AppScope is bundled with Edge and does not need to be installed.
- Running Edge with AppScope requires that Edge either run as root on a Linux host, or in a Docker container that is in privileged mode. (If this is a problem for you, see this workaround).
- To work with an AppScope host, all Edge nodes in a Fleet should be either all in Docker containers, or, all directly on Linux hosts. Plan to keep a ratio of one AppScope Source to one Fleet.
Fleet Checklist
This section compiles basic checkpoints for successfully launching a Fleet.
1. System
- 1 Leader Node (recommended: 8 vCPU/16 GB RAM).
- N Edge Nodes (depending on your environment).
- Free license, or acquire an Enterprise/Trial License from the Cribl Sales Team.
2. Configure Leader Node
- Install
git
, if not present (yum install git
). - Open the necessary ports.
- Download, install, and launch Cribl Edge (Linux, Windows).
- Configure as a Leader.
- Enable Start on Boot.
- Install License.
3. Configure Edge Nodes
- Enable GUI Access. Administrators will need to connect to the TCP:9420 port on each Node.
- Download, install, and launch Cribl Edge (Linux, Windows).
- Configure as a Managed Edge Node.
- Point to the Leader address (optionally, use the configured access token).
- Give each Edge Node an arbitrary tag like
POV
.
- Enable Start on Boot.
4. Map Edge Nodes to Fleets
- On the Leader Node, create a Fleet.
- Name the Fleet (abitrarily)
POV
.
- Name the Fleet (abitrarily)
- On the Leader Node, confirm that Edge Nodes are connecting.
- From the Leader Node’s sidebar, select Edge Nodes.
- Map Nodes to the
dev
Fleet.- Use the Filter to select the tag you applied when configuring Nodes:
cribl.tags.includes('POV')
.
- Use the Filter to select the tag you applied when configuring Nodes:
Configure Edge Node Count
Enter the estimated number of Edge Nodes in this deployment, which is used to calculate how many Edge-specific connections service processes to spawn. Changing this number could restart any currently running service processes. If left blank, defaults to 0.
To configure the Edge Node Count:
- From Settings, select the Global tab, select Limits, and then select Others.
- Enter the number of Edge Nodes in the Edge Nodes count field.
Configure Connection Processes
To configure the connection processes for your Edge Nodes:
- From Settings, select the Global tab, select Service Processes, and then select Services.
- Confirm that Connections listener number of processes is set to its default
1
.
The Connections listener number of processes is automatically determined by the Edge Node Count setting you enter above. Any value you enter manually will be overridden by this calculation.