Job Summary:
- We are seeking an experienced ELK Architect to design, implement, and manage enterprise-scale observability, log analytics, and monitoring solutions using the Elastic Stack (ELK).
- The ideal candidate will possess deep expertise in Elasticsearch, Logstash, Kibana, Beats, and observability platforms, with experience in architecting highly available and scalable logging infrastructures.
Key Responsibilities:
- Design and architect large-scale ELK Stack deployments for log management, monitoring, and observability.
- Build scalable and highly available Elasticsearch clusters.
- Develop data ingestion pipelines using Logstash, Beats, and other data collection frameworks.
- Create dashboards, visualizations, and reports using Kibana.
- Define log retention, indexing, and lifecycle management strategies.
- Optimize Elasticsearch cluster performance, query efficiency, and storage utilization.
- Implement security controls including RBAC, SSL/TLS, authentication, and authorization.
- Design disaster recovery, backup, and high-availability architectures.
- Integrate ELK with cloud platforms, containerized environments, and enterprise applications.
- Collaborate with DevOps, Infrastructure, Security, and Application teams to establish observability standards.
- Troubleshoot complex performance and operational issues across the ELK ecosystem.
- Provide technical leadership and mentor engineering teams on ELK best practices.
Required Skills:
- Strong experience in Elasticsearch, Logstash, Kibana, Filebeat, Metricbeat, and Auditbeat.
- Hands-on experience architecting enterprise-grade ELK platforms.
- Expertise in Elasticsearch cluster sizing, shard allocation, indexing, and performance tuning.
- Experience with Linux administration and shell scripting.
- Knowledge of observability concepts including logs, metrics, traces, and APM.
- Experience with CI/CD pipelines and DevOps practices.
- Strong understanding of networking, security, and infrastructure architecture.
- Experience with Docker and Kubernetes environments.
- Knowledge of REST APIs and data integration techniques.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
Preferred Skills:
- Experience with Elastic Observability and Elastic Security.
- Exposure to OpenTelemetry.
- Experience integrating ELK with Kafka, Redis, and messaging platforms.
- Knowledge of infrastructure monitoring tools.
- Elastic certifications are preferred.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 10+ years of overall IT experience with 5+ years in ELK/Observability architecture roles.
Nice to Have:
- Experience in BFSI, Capital Markets, or large-scale enterprise environments.
- Experience managing multi-terabyte Elasticsearch clusters.
- Knowledge of compliance, audit, and security monitoring requirements.
