Arrow Electronics
Ahmedabad, Gujarat, India
Position: Lead Data Platform Engineer (OpenSearch) Job Description: Role: Lead Data Platform Engineer (AWS | Kafka | OpenSearch) Preferred Location: Ahmedabad, Pune, Indore Years of Experience: 08 – 12 years Notice Period – 0-30 Days (Preferred) Introduction Our team builds a data platform that reliably collects, processes, and retrieves large-scale IoT data based on AWS. We are seeking senior engineer who can design unobstructed flow even among billions of data records, push data storage performance to the limit, and technically lead service growth. Key Responsibilities High-availability data pipeline design: AWS MSK (Kafka), end-to-end data streaming architecture design and operation using Logstash Storage optimization and sharding strategies: Optimizing large-scale search performance through OpenSearch's index design, sharding, and lifecycle (ISM) management Data Modeling and Partitioning: Table partitioning and data modeling in...