Job Description:
• We are looking for an Azure Data Engineer with strong experience in building and managing data solutions on Microsoft Azure.
• The candidate should have 10+ years of IT experience, including at least 5 years hands on experience with Azure service offering (must have) such as
• Azure Data Factory
• Azure Databricks
• Data Quality (DLT & DQX)
• Azure SQL (Should be an expert)
• Azure Key Vault
• Azure Entra ID
• Azure Devops
• DABS
• Azure RBAC
• Azure IAM
• Encrypt and decrypt PII data across systems and manage access through secure service accounts.
• Implement and manage Data Replication and CDC processes for efficient data movement using tools such as Stelo and similar technologies
• Strong knowledge of PySpark and SQL to process, transform, and analyze large datasets
• Collaborate and coordinate with onshore and offshore teams for development, testing, and support.
• Implement Data Quality on databricks pipelines
• Agents creation in databricks
• Have hands on experience on Databricks AI related components.