In the past, when most applications were built in monolith architecture, surely some of you remember how you managed logs. The application was deployed on a few servers, and in a case when some errors occurred, usually the logs were downloaded and searching errors e.g. via grep tool, within all log files from all servers. Currently, when systems are built mostly as distributed systems (microservices, cloud-native, etc), the more sophisticated approach of log managed is needed.
The solution collects application logs, events from the large systems and stores them in a searchable format in Elasticsearch. Data transformations have been achieved using Logstash and Kibana is used for further analysis and visualization. Based on data stored in Elasicsearch we developed a friendly interface to find the appropriate data