Log ingestion, Logstash, Python, Redis
The candidate will be responsible for evaluating, designing, and implementing the log ingestion and processing pipeline.
• Work with internal and external teams to ensure proper processing of all corporate security logs.
• Engineer custom log ingestion solutions.
• Enrich security events with multiple internal and external feeds.
• Code custom high volume log enrichment solutions and parsers.
• Responsible for maintaining the ETL pipeline.
Knowledge and Experience with the following technologies or equivalent:
• Parsing logs with Logstash
• Experience consuming/producing logs from Kafka
• Experience with coding in Python, Golang, C
• Experience with Redis
• Log ingestion/generation applications like Elastic Beats and syslog.
• Experience Deploying applications in Docker/Openshift