Data Engineer/ Architect (Python, Spark, Databricks, Data Lake)

Title: Data Engineer/ Architect (Python, Spark, Databricks, Data Lake) Location: Dubai, UAE (Hybrid) Employment Contract. Job Description: - 10+ years of experience for Data Lake Engineer - Strong experience with Python, SQL and languages like PySpark and distributed data processing frameworks using Spark - Hands-on experience in Data Lake - Experience with CI/CD tools and infrastructure automation - Experience deploying CI/CD pipelines in cloud environments - Strong understanding of data modeling, ETL, and batch/stream processing. - Should be aware of agile terminologies Mandatory skills* - Python, Spark, Databricks, CI/CD, Docker, Kubernetes, Cloud deployment, Data pipelines, - The role needs strong Python skills and should have strong Data lake concepts. - They should handle CI/CD deployment tracking. Desired skills* - Knowledge of containerization and orchestration (Docker, Kubernetes) will be a nice to have skill. Show more Show less

10+ years of experience for Data Lake Engineer; Strong experience with Python, SQL and languages like PySpark and distributed data processing frameworks using Spark; Hands-on experience in Data Lake; Experience with CI/CD tools and infrastructure automation; Experience deploying CI/CD pipelines in cloud environments; Strong understanding of data modeling, ETL, and batch/stream processing; Should be aware of agile terminologies