About the Role
We’re seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines & real‑time streaming solutions. Expertise in Databricks, Apache Spark, Kafka, and modern data architecture is essential.
🔑 Key Responsibilities
Develop & maintain batch + streaming pipelines
Implement real‑time solutions with Spark Structured Streaming
Manage ingestion & schema registry via Kafka
Optimize workflows with Databricks & Spark
Apply Medallion Architecture (Bronze, Silver, Gold)
Ensure data quality, governance & performance tuning
🛠 Required Skills
Apache Kafka, Databricks, Spark Structured Streaming
SQL & Spark SQL (optimized queries)
Performance tuning (partitioning, caching, AQE)
Data governance & schema enforcement