Skip to main content
Skip table of contents

Logging Stack Application Sizing Recommendations

# of worker nodes

Log Generating Load

Application

Suggested Configuration

50

1.4 MB/s

Logging Operator Logging Override Config

CODE
values.yaml: |-
  clusterOutputs:
    - name: loki
      spec:
        loki:
          # change ${WORKSPACE_NAMESPACE} to the actual value of your workspace namespace
          url: http://grafana-loki-loki-distributed-gateway.${WORKSPACE_NAMESPACE}.svc.cluster.local:80
          extract_kubernetes_labels: true
          configure_kubernetes_labels: true
          buffer:
            disabled: true
            retry_forever: false
            retry_max_times: 5
            flush_mode: interval
            flush_interval: 10s
            flush_thread_count: 8
          extra_labels:
            log_source: kubernetes_container
  fluentbit:
    inputTail:
      Mem_Buf_Limit: 512MB

  fluentd:
    bufferStorageVolume:
      emptyDir:
        medium: Memory
    disablePvc: true
    scaling:
      replicas: 10
    resources:
      requests:
        memory: 1000Mi
        cpu: 1000m
      limits:
        memory: 2000Mi
        cpu: 1000m

Loki

CODE
ingester:
  replicas: 10
distributor:
  replicas: 2

100

8.5 MB/s

Logging Operator Logging Override Config

CODE
values.yaml: |-
  clusterOutputs:
    - name: loki
      spec:
        loki:
          # change ${WORKSPACE_NAMESPACE} to the actual value of your workspace namespace
          url: http://grafana-loki-loki-distributed-gateway.${WORKSPACE_NAMESPACE}.svc.cluster.local:80
          extract_kubernetes_labels: true
          configure_kubernetes_labels: true
          buffer:
            disabled: true
            retry_forever: false
            retry_max_times: 5
            flush_mode: interval
            flush_interval: 10s
            flush_thread_count: 8
          extra_labels:
            log_source: kubernetes_container
  fluentbit:
    inputTail:
      Mem_Buf_Limit: 512MB

  fluentd:
    bufferStorageVolume:
      emptyDir:
        medium: Memory
    disablePvc: true
    scaling:
      replicas: 15
    resources:
      requests:
        memory: 1000Mi
        cpu: 1000m
      limits:
        memory: 2000Mi
        cpu: 1000m

Loki Override Config

CODE
ingester:
  replicas: 12
distributor:
  replicas: 3
loki:
  structuredConfig:
    limits_config:
      ingestion_rate_mb: 1024
      ingestion_burst_size_mb: 1024
      per_stream_rate_limit: 30MB
      per_stream_rate_limit_burst: 60MB
      max_streams_per_user: 0
      max_global_streams_per_user: 0
      max_label_names_per_series: 40
gateway:
  nginxConfig:
    httpSnippet: |-
      client_max_body_size 50M;
    serverSnippet: |-
      client_max_body_size 50M;

Refer to AppDeployment resources for information on how you customize your AppDeployments.

When configuring storage for logging-operator-logging-overrides, ensure that you create a ConfigMap in your workspace namespace for every cluster in that workspace.
Keep in mind that logging-operator-logging-overrides can only be configured via the CLI.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.