Data Engineer (Azure Databricks)

DATA ENGINEER (AZURE DATABRICKS) POSITION OVERVIEW Join a dynamic, diversified group of companies specializing in distribution, ship supply, retail, and wholesale operations as a Data Engineer focused on Azure Databricks. This is your chance to be part of a rapidly growing organization at the forefront of technology, working on enterprise-scale data initiatives across African operations. You will be based in either Kigali, Rwanda or Nairobi, Kenya, contributing to modern data platform development that supports the entire organization and its group-wide operations. Our client is embarking on a significant digital transformation, building a contemporary enterprise data platform. The current technology landscape includes Microsoft Dynamics 365 Business Central, Microsoft Dynamics NAV, MuleSoft integration services, Azure technologies, and Power BI analytics. We are currently deploying an Azure Databricks Lakehouse platform designed to create a scalable, governed, and future-ready data ecosystem. This role offers you the opportunity to shape and develop the next generation of our enterprise data infrastructure. KEY RESPONSIBILITIES You will design, develop, and maintain scalable data pipelines using Azure Databricks while building and managing data ingestion processes from ERP, sales, logistics, finance, warehouse, and external systems. Your work will include developing and maintaining Lakehouse data architectures following Medallion principles (Bronze, Silver, Gold layers). You'll create robust ETL/ELT processes using Databricks, PySpark, SQL, and Azure services while implementing data quality, validation, monitoring, and governance processes. Additionally, you will develop and maintain dimensional data models supporting business intelligence and reporting requirements, working closely with Business Analysts, BI Developers, and Business Stakeholders to translate business requirements into scalable data solutions. Performance optimization will be an ongoing responsibility, ensuring data processing workloads achieve maximum efficiency, reliability, and cost effectiveness. You'll support both real-time and batch data processing initiatives while contributing to continuous improvement initiatives and adoption of modern data engineering best practices. REQUIRED QUALIFICATIONS AND EXPERIENCE You must have proven experience working in a Data Engineering role with strong knowledge of SQL and relational databases. Experience developing ETL/ELT pipelines is mandatory, along with hands-on experience with Azure Databricks, Spark, or similar cloud-based data platforms. Strong programming skills using Python and/or PySpark are essential. You should have experience designing and implementing data models and data warehouse solutions, plus knowledge of data governance, data quality, and master data management principles. Experience integrating data from multiple systems and APIs is required. You'll need strong analytical and problem-solving abilities, excellent communication and stakeholder management skills, and the ability to work independently while remaining a collaborative team player. A diploma-level qualification is the minimum educational requirement. ADVANTAGEOUS SKILLS AND CERTIFICATIONS Experience with Microsoft Azure Data Services, Delta Lake, and Unity Catalog will strengthen your application. Familiarity with Azure Data Factory, Power BI and analytics platforms, and MuleSoft integrations is highly valued. Prior experience with Microsoft Dynamics Business Central or NAV would be beneficial. Relevant certifications such as Databricks Certifications or Azure Data Engineer Associate Certification (DP-203) are desirable. WHAT THIS OPPORTUNITY OFFERS You'll gain the opportunity to work on a modern Azure Databricks Lakehouse implementation while gaining exposure to large-scale distribution, retail, logistics, and supply chain datasets. This position provides international project exposure across multiple African and European markets within a well-established and rapidly evolving organization. You'll experience professional growth in a collaborative and innovative work environment supported by a competitive remuneration package and comprehensive benefits. EMPLOYMENT DETAILS Position Type: Full Time Work Location: On-site Location: Nairobi County, Kenya or Kigali, Rwanda Salary: Competitive package (details available upon application) Additional Compensation: Benefits package included