Home / Edge/ Deploying Edge·Deployment Planning

Deployment Planning

When you’re planning an Edge deployment, consider these key factors:

  • The amount of data (metrics, logs, custom command outputs, and so on) that you plan for Edge to collect from the endpoint and ingest per unit of time. For example, MB/s or GB/day.
  • The amount of processing that will happen on incoming data. For example, are there a lot of transformations, regex extractions, parsing functions, field obfuscations, and so on?
  • Routing and/or cloning: Is most data going to a single Destination, or is it being cloned and routed to multiple places? This is important, because Destination-specific serialization tends to be relatively expensive.
  • Deploying onto servers with no internet access: If you plan to deploy Edge Nodes on air-gapped on-prem servers (servers with no internet access), you must ensure that every Edge Node can communicate with a Leader that is also on-prem (that is, not in Cribl.Cloud).

Type of Deployment

  • Use Cribl Cloud to quickly launch a Cribl-hosted deployment of the combined Cribl applications suite (Edge, Stream, and Search). With this option, Cribl assumes responsibility for provisioning and managing all infrastructure, on your behalf.

  • Use Single-Instance Deployment when incoming data volume is low, and/or amount of processing is light.

  • Use Fleet Management to accommodate increased load. See Add/Update Edge Nodes to streamline Edge Nodes’ deployment via scripting.

System Requirements

Edge Nodes should have sufficient CPU, RAM, network, and storage capacity to handle your specific workload. It’s very important to test this before deploying to production.

Requirement TypeRequirements Details
Minimum: Edge NodesOS: Linux: RedHat, CentOS, Ubuntu, AWS Linux, Suse, Windows Server (64bit)
System: ~1Ghz processor, 512MB RAM, 5GB of free disk space (more if persistent queuing is enabled on Edge Nodes)
Recommended: Leader NodeOS: Linux: RedHat, CentOS, Ubuntu, AWS Linux, Suse (64bit)
System: +4 physical cores, +8GB RAM, 5GB free disk space

Edge Nodes can’t be installed on Windows laptops/desktops.

Linux Requirements

  • 64-bit kernel >= 3.10 and glibc >= 2.17.
  • SELinux: Enforcing mode is supported, but not required.

Tested Platforms (Linux)

  • OS (Intel Processors):

    • Ubuntu 16.04+, Debian 9+, RHEL 7+, CentOS 8+, SUSE Linux Enterprise Server 12+, Amazon Linux 2014.03+.
  • OS (ARM64 Processors):

    • Ubuntu (14.04, 16.04, 18.04, and 20.04), CentOS (8. 9), and Amazon Linux 2.

Windows Requirements

  • Windows Server 2016, 2019, and 2022.

Browser Support

  • Chrome, Firefox, Safari, and Microsoft Edge: the five most-recent versions.

Leader Scalability

Our System Requirements suffice for Leaders handling up to 3,000 Edge Nodes. To support more than 3,000 Nodes, see our Scaling Edge Beyond 3k Nodes guide.

Leader/Edge Nodes Compatibility

Leaders on v.4.2.x are compatible with Edge Nodes on v.4.1.2, v.4.1.3, and later. Due to a security update, Edge Nodes running on v.4.0.4 cannot receive configurations from v.4.2.x Leaders. For details, see Leader and Edge Nodes Compatiblity.

About Licensing

  • Free: Entitles users to manage up to 100 Edge Nodes, in a single Fleet, and ingest up to 1TB/day.
  • Enterprise: Entitles users to manage unlimited Edge Nodes, across unlimited Fleets and ingest up to its rated volume.

Permissions and Rights

You do not need elevated privileges to install Edge. However, you will need:

  • Administrator (or equivalent) rights in order to enable Edge to start on boot.
  • Sufficient rights to access the resources that need monitoring – files, metrics, etc.

Performance Considerations

As with most data-collection and -processing applications, Cribl Edge’s expected resource utilization will be proportional to the data volume and type of processing. For instance, a Function that adds a static field on an event will perform faster than one that applies a regex to find and replace a string.

  • Processing performance is proportional to CPU clock speed.
  • All processing happens in-memory.
  • Processing does not require significant disk allocation.

Thinking about your planned Edge deployment as a whole, it’s critical to consider cardinality: how many Fleets, of what size, will send metrics to a given Leader. In a very low-cardinality deployment, a Leader Node might aggregate metrics from one small Fleet; in a very high-cardinality deployment, a Leader Node might aggregate metrics from many large Fleets.

Too many Edge Nodes sending too many metrics can degrade Leader performance and/or integrity. By carefully choosing what metrics each Fleet sends to its Leader Node, you can ensure that you collect the metrics most important to you, within the limits of the Leader’s capacity to process them.

As part of your deployment planning, decide which of the following four sets of metrics each Fleet in your deployment will send to its Leader Node:

  • Minimal: Limited to metrics for events and bytes in and out. Recommended for high-cardinality deployments.
  • Basic (the default set): All the metrics required to display all monitoring data available in the Edge UI. Contains all the metrics in the Minimal set, and more.
  • All: All metrics, sent without filtering.
  • Custom: Only metrics that match a JavaScript expression that you define.

For a listing of the metrics each set provides, see Controlling Metrics in Cribl Edge.

How Edge Works with AppScope

AppScope is an Open Source utility from Cribl that can send events, metrics, and/or payloads from a process or application to an AppScope Source on Edge.

Here’s what to keep in mind when you plan to use Edge and AppScope together:

  • AppScope is bundled with Edge and does not need to be installed.
  • Running Edge with AppScope requires that Edge either run as root on a Linux host, or in a Docker container that is in privileged mode. (If this is a problem for you, see this workaround).
  • To work with an AppScope host, all Edge nodes in a Fleet should be either all in Docker containers, or, all directly on Linux hosts. Plan to keep a ratio of one AppScope Source to one Fleet.

Fleet Checklist

This section compiles basic checkpoints for successfully launching a Fleet.

1. System

  • 1 Leader Node (recommended: 8 vCPU/16 GB RAM).
  • N Edge Nodes (depending on your environment).
  • Free license, or acquire an Enterprise/Trial License from the Cribl Sales Team.

2. Configure Leader Node

3. Configure Edge Nodes

  • Enable GUI Access. Administrators will need to connect to the TCP:9420 port on each Node.
  • Download, install, and launch Cribl Edge (Linux, Windows).
  • Configure as a Managed Edge Node.
    • Point to the Leader address (optionally, use the configured access token).
    • Give each Edge Node an arbitrary tag like POV.
  • Enable Start on Boot.

4. Map Edge Nodes to Fleets

  • On the Leader Node, create a Fleet.
    • Name the Fleet (abitrarily) POV.
  • On the Leader Node, confirm that Edge Nodes are connecting.
    • From the Leader Node’s top nav, click Manage and select Edge Nodes.
  • Map Nodes to the dev Fleet.
    • Use the Filter to select the tag you applied when configuring Nodes: cribl.tags.includes('POV').

Configure Connection Processes

To configure the connection processes for your Edge Nodes:

  1. From the top nav, select Settings > Global Settings > Service Processes > Services.
  2. Confirm that Connections listener number of processes is set to its default 1.