Arrow Electronics
Ahmedabad, Gujarat, India
Position: Lead Data Engineer Job Description: Job Title: Data Engineer with ML Exposure Role Summary Tech Lead with core experience in Data Engineering and have good understanding of Machine Learning. Build and operate scalable, reliable data pipelines on Azure. Develop batch and streaming ingestion, transform data using industry standard data analytics and AI platform (PySpark/SQL), ADF/Snowflake or equivalent, enforce data quality, and publish curated datasets for analytics and ML. Good understanding of supervised, unsupervised learning, model evaluation, and feature engineering Key Responsibilities Design, build, and maintain ETL/ELT pipelines in Azure Data Factory and equivalent tool across Bronze → Silver → Gold layers/Medallion Architecture. Implement Delta Lake best practices (ACID, schema evolution, MERGE/upsert, time travel, Z-ORDER). Write performant PySpark and SQL; tune jobs (partitioning, caching, join strategies). Create reusable...