Azure Data Engineer (Databricks)
-
Location
India
-
Sector:
-
Job type:
-
Salary:
Up to £0.00 per annum
-
Contact:
Rebecca Virk
-
Contact email:
r.virk@ioassociates.co.uk
-
Job ref:
BBBH155405_1739351890
Job Title: Senior Data Engineer
Location: Mohali | Onsite
Salary : Open for discussion
iO Associates is looking for a Senior Data Engineer who will be responsible for developing and optimizing data pipelines, implementing scalable Azure architectures, leveraging Unity Catalog and Delta Live Tables for governance and automation, and supporting seamless data exchange across platforms. Ideal for candidates with expertise in PySpark, ADLS Gen2, and CI/CD practices.
Required:
- 7+ years relevant and progressive experience in data engineering
- Develop and optimize data pipelines using Databricks, ensuring efficient data ingestion, transformation, and management.
- Leverage Unity Catalog for secure data governance and Delta Live Tables for automated workflows.
- Design and implement scalable Azure-based data architectures, integrating Synapse, Azure Data Factory (ADF), and Data Lake.
- Deep technical knowledge of Databricks (Unity Catalog and Delta Live Tables), PySpark, Python, Scala, and Microsoft Azure components, including Synapse, ADF pipelines, and Synapse stored procedures.
- Hands-on experience working with data pipelines across various source and target systems (e.g., Databricks, Synapse, SQL Server, Data Lake, file-based systems, SQL, and No-SQL databases).
- Proficient in engineering practices like development, code refactoring, design patterns, CI/CD, and building scalable data applications and processes
This is the position for you if you want to work for a company that values its employees' health and well-being and invests in developing and rewarding talent.
If you are interested in learning more about the opportunity, please email or call Rebecca Virk at +91 8427596525
