Logging with an AWS Managed Elasticsearch Cluster

A quick introduction to setting up AWS managed elasticsearch, kibana, cognito and cloudwatch subscription filters

Introduction

Overview of some of the places you will receive logs in AWS directed at an ES cluster. ©JasonPoley

Elasticsearch (ES)

In the end, anything has to be better than cloudwatch so pick the best thing for you.

Creating the Resources

AWS Managed ElasticSearch

Cognito

Subscription Lambda

Lambda Subscription Tool

Maintainance

Conclusion

This is the number of log streams from each app
This is the number of logs from each app vs time

A DevOps engineer specialised in cloud infrastructure with a background in theoretical and experimental physics.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store