You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+13-4Lines changed: 13 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -2,12 +2,13 @@
2
2
**Ready to go Docker configuration for set up ELK stack in a minutes**
3
3
4
4
## Description
5
-
6
5
-[Elasticsearch](https://hub.docker.com/_/elasticsearch/) - official image with data volume in `elasticsearch/data` directory
7
-
-[Logstash](https://hub.docker.com/_/logstash/) - official image + custom configuration, which takes care about Filebeat, Topbeat and PacketBeat index templates for Elasticsearch + multiline option for stacktraces correct representation
6
+
-[Logstash](https://hub.docker.com/_/logstash/) - official image + custom configuration which takes care about Filebeat, Topbeat and Packetbeat index templates for Elasticsearch + multiline option for correct stacktraces representation
8
7
-[Kibana](https://hub.docker.com/_/kibana/) - official image
9
8
-[Curator](https://github.com/elastic/curator) - lightweight 50mb container which could run scheduled tasks against Elasticsearch to manage its indices (delete, optimize, snapshot, etc)
1. Install required Beats shippers on the host which should be monitored
13
14
2. Install Docker and Docker Compose on the ELK host
@@ -24,7 +25,15 @@ Keep track of your containers execution. For example, controll Curator scheduled
24
25
docker-compose logs curator
25
26
```
26
27
28
+
## Scaling up
29
+
This simple configuration will run very happily on your laptop, but it can be easely scaled up for highload production servers with a huge amount of logs and monitoring data.
30
+
31
+
- Learn about [Elasticsearch cluster and horizontal scaling](https://www.elastic.co/guide/en/elasticsearch/guide/current/distributed-cluster.html)
32
+
- Consider [Logstash scaling](https://www.elastic.co/guide/en/logstash/current/deploying-and-scaling.html) with multiple shipping and indexing instances with MQ in the middle
33
+
27
34
## Notes
28
-
- You may want to add nginx container with HTTP Basic Auth config for Kibana
35
+
- You may want to add [Kibana Shield plugin](https://www.elastic.co/guide/en/shield/current/kibana.html) for users authentication
36
+
- It might be really helpful to use [Elasticsearch Watcher](https://www.elastic.co/products/watcher) or [Yelp ElastAlert](https://github.com/Yelp/elastalert) to get notified on significant events or anomalies in your data
29
37
- You can specify resource limits (like CPU and memory allocation) for each docker container
30
-
- Feel free to contact me with any questions and issues
38
+
39
+
Feel free to contact me with any issues and questions
0 commit comments