Azure Data Engineer Required in Dubai - Dubai

Azure Data Engineer Required in Dubai

Job Description

Summary:

We are seeking a Data Engineer with deep expertise in ETL/ELT, PySpark, Databricks, Azure

ecosystem, and experience with Enterprise Systems like Oracle ERP, ERP Fusion, and Salesforce. Thesuccessful candidate will play a key role in designing and implementing complex data pipelines,handling both structured and unstructured datasets, and optimizing our Azure-based data systems.

The successful candidate will have a strong foundation in data warehousing concepts and database design. Additionally, this individual will work closely with other data engineers & the data science team to support their analytics needs and improve the performance of our data products.

Key Responsibilities:

· Design, construct, install, test, and maintain highly scalable and robust data management

systems.

· Understand and apply data warehousing concepts to design and implement robust data

warehouse tables in line with business requirements.

· Build complex ETL/ELT processes for large-scale data migration and transformation across

platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.

· Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc

· Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets,

improve the performance, and enhance scalability of our data operations.

· Develop and implement Azure-based data architectures consistent across multiple projects

while adhering to best practices and standards.

· Lead initiatives for data integrity and normalization within Azure data storage and processing

environments.

· Evaluate and optimize Azure-based database systems for performance efficiency, reusability,

reliability, and scalability.

· Troubleshoot complex data-related issues within Azure and provide expert guidance and

support to the team.

· Ensure all data processes adhere to governance, data security, and privacy regulations.

Required Qualifications:

· Bachelor's degree in Computer Science, Information Technology, Engineering, or a related

field.

· 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data

engineer.

· Expertise in Python, SQL, and deep understanding of PySpark.

· Proficient in Databricks or similar big data solutions.

· Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.

Proven experience in designing and deploying high-performance data processing systems on.

· Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure

SQL Data Warehouse, Azure Databricks.

· Ability to design and implement data schemas, data models, and database designs in

accordance with business requirements.

Preferred Qualifications:

· Databricks certification or equivalent big data technology certification.

· Exceptional analytical and problem-solving abilities.

· Excellent communication skills.

interested candidates please share your updated CV to lavanya.s@lucidspire.com

Posted on : last year, #2004, 1 views

It is ok to contact this poster with commercial interests.

Report as inappropriate