Testground
GitHubGo SDKInfra
master
master
  • README
  • Table of contents
    • What is Testground?
      • Community
    • Concepts and architecture
      • Test plans and test cases
      • Daemon and client
      • Synchronization service
      • Networking
      • Sidecar
      • Builders
      • Runners
      • Runtime environment (runenv)
      • Client-Server communication
    • Getting started
    • Writing test plans
      • Quick start
      • Understanding the test plan manifest
      • Parameters and test cases
      • Keeping instances in sync
      • Communication between instances
      • Observability, assets and metrics
    • Managing test plans
    • Running test plans
    • Traffic shaping
    • Analyzing test run results
      • Capturing profiles
    • Debugging test plans
    • Docker Settings
    • Featured projects
  • Runner library
    • local:exec
    • local:docker
      • System overview
      • Runner flags
      • Troubleshooting
    • cluster:k8s
      • System overview
      • How to create a Kubernetes cluster for Testground
      • Monitoring and Observability
      • Understanding Testground performance on Kubernetes
      • Troubleshooting
  • Builder Library
    • docker:go
    • exec:go
    • docker:generic
Powered by GitBook
On this page
  • Infrastructure monitoring
  • Access Grafana
  • Dashboards
  • Cluster-wide resources utilisation
  • Worker node resources utilisation
  • Application / Test run monitoring
  • Redis monitoring
  • WeaveNet monitoring
  1. Runner library
  2. cluster:k8s

Monitoring and Observability

PreviousHow to create a Kubernetes cluster for TestgroundNextUnderstanding Testground performance on Kubernetes

Last updated 2 years ago

Infrastructure monitoring

In order to understand what your Kubernetes cluster is doing, you can use Grafana and check the dashboards.

Access Grafana

Port forward the Grafana service to a local port. Then access Grafana on

Default admin credentials are username: admin ; password: admin

$ kubectl port-forward service/prometheus-operator-grafana 3000:80

Dashboards

By default the Testground infrastructure playbooks auto-provision a set of dashboards that provide visibility into the Testground infrastructure:

As Testground matures, these dashboards are likely to change.

Cluster-wide resources utilisation

You can view aggregated resources usage on the whole Cluster with the USE Method / Cluster dashboard.

Worker node resources utilisation

You can view CPU, memory, network, disk utilisation per node at the USE Method / Nodeedashboard.

Application / Test run monitoring

In order to understand what your test run is doing, you can use Grafana and view some of the metrics emitted by it to InfluxDB, while it is running, such as the:

  • Life-cycle events

  • Diagnostics (i.e. go runtime metrics)

Redis monitoring

Redis is an integral part of the sync service used to provide synchronisation and coordination between test plan instances. You can check it's utilisation on the Redis dashboard.

WeaveNet monitoring

WeaveNet is used for the data plane in Testground - all test plan instances communicate with each other over WeaveNet. You can check statistics from the usage of the network at the WeaveNet dashboards.

http://localhost:3000
Currently provisioned dashboards in Grafana