Elastic Stack Engineer

Job Description: Elastic Stack Engineer (Search & Observability) Role Overview As an Elastic / Observability & Security Platform Engineer, you will lead the design, implementation, monitoring and continuous improvement of our Elastic-based observability and security stack. You will take ownership of detection rules, watchers, ML-models, health monitoring of data streams, alerting frameworks, and tracking of data pipeline latency/integration times. You will work closely with data engineers, security operations, platform engineering, and business-units to ensure robust real-time monitoring, anomaly detection, alerting, and data integration observability. Key Responsibilities • Architect, deploy, configure and optimise the Elastic Stack (Elasticsearch, Kibana, Beats, Logstash, Elastic Machine Learning, Elastic Watcher/Alerting). • Develop and maintain JSON-based configuration files, logic and pipelines for detection rules, watchers and alerting states. • Design, build and operationalise machine-learning jobs within Elastic ML (e.g., anomaly detection, forecasting, classification) for observability/security use-cases. • Monitor, maintain and improve the health and performance of data-streams (logs, metrics, events, traces) ingesting into the Elastic cluster: ensure data freshness, minimal latency, correct mapping, index lifecycle management (ILM), shard management, and cluster health. • Implement and maintain alerting/notification frameworks: watchers/triggers, custom ale