Senior Data Engineer – PySpark & Cloudera CDP | Dubai, UAE

Location

Dubai, United Arab Emirates – On-site / Hybrid

Job Category

• Information Technology (IT) & Software
• Engineering & Technical
• Science & Research

Job Overview

We are seeking an experienced Senior Data Engineer with strong expertise in PySpark, Python, and Cloudera Data Platform (CDP) to join a high-performing Data Engineering team in Dubai. The role will support enterprise-scale digital products and transaction banking initiatives, contributing to the development of scalable and reliable data solutions for business-critical applications.

The successful candidate will design, develop, optimize, and maintain large-scale data pipelines within modern Big Data ecosystems. The position requires strong expertise in distributed data processing, data quality, cloud-native data platforms, and enterprise data engineering practices. The role will have a direct impact on the organization’s ability to deliver high-performance data solutions supporting business intelligence, analytics, and machine learning initiatives.

This is a senior-level opportunity offering strong potential for career growth and professional development within enterprise data engineering. The role provides exposure to large-scale data architecture, modern Big Data technologies, digital banking products, analytics, and cross-functional collaboration with Data Architects, Data Scientists, Product Owners, and business stakeholders.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines using PySpark and Python.
• Build and maintain enterprise-scale data processing solutions within Cloudera Data Platform (CDP).
• Develop distributed data processing workflows for large and complex datasets.
• Optimize data pipelines for performance, scalability, reliability, and efficiency.
• Implement enterprise data engineering best practices across the data lifecycle.
• Develop solutions that meet data quality, security, governance, and performance requirements.
• Work with Data Architects to implement scalable and sustainable data architectures.
• Collaborate with Data Scientists and Analytics teams to support machine learning, analytics, and business intelligence initiatives.
• Work closely with Product Owners and business stakeholders to understand data requirements and deliver effective technical solutions.
• Troubleshoot and resolve data pipeline, processing, and performance issues.
• Contribute to the modernization and optimization of enterprise data platforms.
• Ensure data engineering solutions comply with organizational security and quality standards.

Requirements & Qualifications

• Strong professional experience in Data Engineering.
• Advanced hands-on expertise in PySpark.
• Strong Python programming skills.
• Extensive experience working with Cloudera Data Platform (CDP) or comparable enterprise Big Data environments.
• Strong understanding of distributed data processing and large-scale data pipelines.
• Experience designing and optimizing enterprise data solutions.
• Knowledge of cloud-native data platforms and modern data engineering architectures.
• Strong understanding of data quality, reliability, scalability, and performance optimization.
• Experience working with Data Architects, Data Scientists, Analytics teams, Product Owners, and business stakeholders.
• Strong problem-solving and analytical skills.
• Excellent communication and stakeholder-management abilities.
• Experience in enterprise digital products or transaction banking environments will be advantageous.

Benefits & Career Growth

• Full-time senior-level career opportunity.
• On-site / hybrid working environment in Dubai.
• Exposure to enterprise-scale digital products and transaction banking initiatives.
• Opportunity to work with modern Big Data and cloud-native data platforms.
• Professional development through hands-on experience with PySpark, Python, Cloudera CDP, distributed data processing, and enterprise data engineering.
• Opportunities to develop expertise in data architecture, analytics, business intelligence, and machine learning ecosystems.
• Cross-functional collaboration with senior technical and business stakeholders.
• Long-term career growth opportunities within enterprise Data Engineering and digital technology environments.
• Opportunities for technical upskilling and relevant professional certification based on organizational requirements.

Application Process

Application Process (Website)

Apply only through the official job link.

Click Apply Now on the website to review the complete job description and access the official application process.

HR Email for Application

Send your updated CV directly

Candidates are encouraged to review the complete job description and ensure their experience matches the technical requirements before applying.