Job Details
Responsibilities:
- Designing and implementing batch and real-time data ingestion pipelines for Azure Data Lake
- Implementing data quality checks
- Implementing data lineage and reconciliation mechanisms (including monitoring dashboards and alerts)
- Implementing data cataloguing, archiving and disaster recovery
- Working with data source and data consumption teams to align on data structures and schemas
Skills:
- General knowledge of PaaS offerings Azure platform
- Azure Data Storage tools (Azure SQL, CosmosDB, Storage Account)
- Azure Analytics Data Platform (Data Factory, Data Lake, Data Warehouse)
- Azure Event hubs, Azure Stream Analytics
- Azure Databricks (with pyspark) or HD Insights
Nice to have:
- C#/.NET - Retail industry experience
Reference www.eduinq.com To get automatically referred, Join www.eduinq.com and earn while searching for a job.
Ref number
VR-48674