Integrating Cassandra, Prometheus, & Grafana with AWS-EKS!

This blog will explain the integration of Cassandra deployment on AWS-EKS with cluster monitoring by Prometheus, & cluster metrics visualization by Grafana! An ultimate integration is explained in this blog which can be used also for the huge deployments.

Image for post
Image for post

In this Agile world, the minimum time it takes to handle the failover for any machine, is the key to keep any business running, or any other service running. We can achieve it manually, but it will be a very slow process.

Pre-requisite Softwares for doing this practical

Flow of the complete Integration

EKS Cluster Creation!

This YAML script is used to create the EKS cluster with 3 worker nodes in Mumbai Region!

Updating kubectl config File!

aws eks update-kubeconfig --name <eks cluster name> --region <region name in which the cluster is running>For example:
aws eks update-kubeconfig --name eks-tw-cluster --region ap-south-1

Creating a Cassandra deployment

sudo yum install amazon-efs-utils
Code for the creation of an EFS Provisioner!
Code for the cluster role binding!
Code to create the EFS Storage!
Image for post
Image for post
Cassandra POD Deployed [Image by Author]

Installing Helm software!

helm repo add stable
kubectl -n kube-system create serviceaccount tillerkubectl create clusterrolebinding tiller --clusterrole cluster-admin --serviceaccount=kube-system:tillerhelm init --service-account tiller

Installing Prometheus using Helm!

helm install prometheus stable/prometheus --namespace prometheus
kubectl -n prometheus port-forward svc/prometheus-server 8888:80
Image for post
Image for post
Output of Prometheus! [Image bu Author]
Image for post
Image for post
Targets of Prometheus! [Image by Author]

Installing Grafana using Helm

helm install grafana stable/grafana --namespace=grafana --set adminPassword=123456 --set service.type=LoadBalancer
Image for post
Image for post
Output of Grafana Cluster!

Big Data Enthusiast, have a demonstrated history of delivering large and complex projects. Interested in working in the field of AI and Data Science.

Get the Medium app