Recommendations

Recommended settings for monitoring and collecting metrics for Kubernetes, platform services, and applications deployed on the Konvoy cluster

At D2iQ, we conduct routine performance testing of Konvoy. The following table provides recommended settings, based on cluster size and increasing workloads, that maintain a healthy Elasticsearch deployment.

NOTE: The resource settings reflect some settings but do not represent the exact structure to be used in the Konvoy cluster.yaml.

Elasticsearch

Cluster Size Number of Pods Number of Services Resource settings
50 1.5k 500 
client:
  heapSize: 1024m
  resources:
    limits:
      cpu: 500m
      memory: 2048Mi
    requests:
      cpu: 100m
      memory: 1536Mi
master:
  heapSize: 1024m
  resources:
    limits:
      cpu: 2000m
      memory: 2048Mi
    requests:
      cpu: 500m
      memory: 1536Mi
data:
  replicas: 6
  heapSize: 3072m
  persistence:
    size: 100Gi
  resources:
    limits:
      cpu: 4000m
      memory: 8192Mi
    requests:
      cpu: 1000m
      memory: 4608Mi
100 3k 1k 
client:
  heapSize: 1024m
  resources:
    limits:
      cpu: 1000m
      memory: 2048Mi
    requests:
      cpu: 500m
      memory: 1536Mi
master:
  heapSize: 4096m
  resources:
    limits:
      cpu: 2000m
      memory: 8192Mi
    requests:
      cpu: 2000m
      memory: 4096Mi
data:
  replicas: 6
  heapSize: 8192m
  persistence:
    size: 100Gi
  resources:
    limits:
      cpu: 4000m
      memory: 16384Mi
    requests:
      cpu: 3000m
      memory: 15000Mi
200 10k 3k 
client:
  heapSize: 1024m
  resources:
    limits:
      cpu: 1000m
      memory: 2048Mi
    requests:
      cpu: 500m
      memory: 1536Mi
master:
  heapSize: 4096m
  resources:
    limits:
      cpu: 2000m
      memory: 8192Mi
    requests:
      cpu: 2000m
      memory: 4096Mi
data:
  replicas: 6
  heapSize: 3072m
  persistence:
    size: 100Gi
  resources:
    limits:
      cpu: 4000m
      memory: 16384Mi
    requests:
      cpu: 1000m
      memory: 15000Mi
300 15k 6k 
client:
  heapSize: 2048m
  resources:
    limits:
      cpu: 4000m
      memory: 4096Mi
    requests:
      cpu: 2000m
      memory: 2048Mi
master:
  heapSize: 4096m
  resources:
    limits:
      cpu: 2000m
      memory: 8192Mi
    requests:
      cpu: 1000m
      memory: 4096Mi
data:
  replicas: 6
  heapSize: 3072m
  persistence:
    size: 100Gi
  resources:
    limits:
      cpu: 4000m
      memory: 16384Mi
    requests:
      cpu: 3000m
      memory: 15000Mi

For information on related topics or procedures, refer to the following: