Data Architect | Databricks - Abu Dhabi

Databricks Lead Location: Abu Dhabi, UAE (Hybrid) Contract: Initial 6 Months Start Date: ASAP A Databricks Lead is required to join a major digital transformation programme within a leading organisation in Abu Dhabi. This is an excellent opportunity for an experienced Databricks professional to play a key role in designing and delivering modern data platform capabilities across a large-scale enterprise environment. You will work closely with architects, engineering teams, and senior stakeholders to deliver strategic data initiatives within a complex and fast-paced environment. Key Responsibilities • Lead the architecture, design, and implementation of enterprise-scale solutions using Databricks. • Provide technical leadership and direction across multiple data engineering workstreams. • Design and build scalable, secure, and high-performing data platforms and pipelines. • Define engineering standards, best practices, and governance across the Databricks ecosystem. • Work closely with business and technology stakeholders to translate requirements into technical solutions. • Drive platform optimisation, performance tuning, and continuous improvement initiatives. • Support technical planning, solution estimation, and roadmap definition. • Mentor and coach engineering teams, promoting engineering excellence and best practices. • Ensure solutions align with enterprise architecture, security, and governance standards. Required Experience ✔ Extensive hands-on Databricks experience in a Lead, Principal, or Architect capacity. ✔ Strong experience designing and delivering enterprise-scale data platforms and solutions. ✔ Deep knowledge of Databricks Lakehouse architecture, Delta Lake, and Apache Spark. ✔ Strong hands-on experience with PySpark and Spark SQL. ✔ Experience building large-scale ETL/ELT pipelines and modern data architectures. ✔ Strong experience with cloud platforms such as Azure, AWS, or GCP. ✔ Experience implementing CI/CD pipelines and DevOps practices. ✔ Strong understanding of data governance, security, and platform best practices. ✔ Excellent stakeholder management and communication skills. ✔ Proven experience leading and mentoring technical teams. Desirable Experience ✔ Experience within Government, Public Sector, or large-scale enterprise transformation programmes. ✔ Experience with real-time data processing and streaming technologies. ✔ Databricks certifications would be highly advantageous. ✔ Previous experience working within consulting or client-facing environments. ✔ Experience operating within large, complex, global organisations. What's on Offer • Initial 6-month contract with strong extension potential. • Opportunity to work on a large-scale, high-profile digital transformation programme. • Competitive Monthly Rate. • Hybrid working model based in Abu Dhabi. • Opportunity to work in a highly collaborative, innovative, and technology-driven environment. Show more Show less