Data Quality Engineer

Job Purpose

CGC Egypt is looking for a Data Quality Engineer to join its team in Cairo.

The DQE will play a key role in the organization by:

• • Preparing and build data pipeline for use-cases including high volume and real time data
  • Acquiring and cleaning data for use in analytics solutions created by the data scientists
  • Working with data-scientists and maintain the total data environment

ACCOUNTIBILITIES

• • Bachelor’s degree in Computer Science, Big Data or Data analytics/engineering
  • 4-6 years of experience on data projects
  • Engineering experience and practice in Data Management, Data Quality verification/Data Governance, Data Integration
  • Good understanding of data pipelines, Data Lakes, ETL testing
  • Knowledge of CI/CD principles and best practices in the data processing
  • Excellent SQL knowledge (aggregation, windows functions)
  • Experience in Python (or other scripting languages)
  • Experience in building up a test automation framework
  • Understanding of Big Data principles
  • Experience in Data analysis & requirements validation
  • Experience in maintaining QA environments
  • Concrete experience in Data project Test Planning, Test Case design, Test Result Reporting
  • Proven ability to work in teams

Position Requirements

• • Play the key role in the data governance processes, including data preparation, generation, data inventory, data integration and data quality control
  • Perform testing of data pipelines, ETLs, APIs, integration, and performance checks
  • Prepare Data Quality environments and applications in compliance with the standards and contribute to the CI/CD process establishment
  • Participate in designing and maintaining data platforms and design and build data quality automation framework including potential troubleshooting issues
  • Responsible for Data quality KPIs (data reliability , integrity, availability)