Job Description

Roles & Responsibilities

Role Profile

Data Quality Management

Design, develop, and implement solutions to monitor, validate, and improve data accuracy, consistency, and completeness.

• Pipeline Development & Optimization Build data quality gates to ensure and maintain scalable data pipelines for processing and validating large datasets efficiently.
• ETL &Data integrations
  Develop and enhance ETL processes to ensure seamless data movement across systems while maintaining data quality dashboards End to End development flow
• Data Governance & Compliance Ensure adherence to data governance policies, regulatory standards, and best practices for data management.
• Root Cause Analysis & Issue Resolution Investigate data anomalies, identify root causes, and implement corrective measures proactively.
• Automation & Monitoring

• Performance Tuning

Optimize query performance, database indexing, and system configurations to enhance efficiency.

• Stakeholder Communication

Work closely with data analysts, engineers, business teams, and vendors to ensure data quality objectives are met

Develop automation scripts and monitoring frameworks to streamline data quality checks and alert on anomalies

Competencies and Qualifications

Understanding the Critical role in ensuring the quality, performance, and reliability of data solutions. The responsibilities and mindset should include:

• Commitment to high data Quality

Passion for developing optimized code to ensure data quality to end user and develop the dashboards for analysis, optimizing performance, and applying a scientific approach to tuning and analysis.

• Agile Community Experience

Working in Agile teams in order to ensure delivering the needed quality gates and proactive actions

• Customer oriented Approach

A deep understanding of customer needs, ensuring that every developed feature and solution enhances the end user experience while proactively identifying and addressing potential issues before they arise. And committed to delivering solutions that enhance customer experience and satisfaction.

Must have technical / professional qualifications:

• Bachelor of computer Science or related domains
• 0 to 1 years in engineering, specifically in building quality gates for data pipelines, ensuring data accuracy, and administering distributed systems..
• Experience in bigdata systems and technologies such as Java, Python, NoSQL, Node.js, Angular, Kafka,Yarn,Hbase Zookeeper,Understanding of distributed systems like Hadoop (HDFS).
• Knowledge of data processing frameworks, such as Apache Hadoop (MapReduce), Apache Spark, Apache Apache Kafka.
• Understanding of data warehousing concepts and technologies Familiarity with ETL tools and processes for efficiently moving and transforming data

Desired Candidate Profile

Must have technical / professional qualifications:

• Bachelor of computer Science or related domains
• 0 to 1 years in engineering, specifically in building quality gates for data pipelines, ensuring data accuracy, and administering distributed systems..
• Experience in bigdata systems and technologies such as Java, Python, NoSQL, Node.js, Angular, Kafka,Yarn,Hbase Zookeeper,Understanding of distributed systems like Hadoop (HDFS).
• Knowledge of data processing frameworks, such as Apache Hadoop (MapReduce), Apache Spark, Apache Apache Kafka.
• Understanding of data warehousing concepts and technologies Familiarity with ETL tools and processes for efficiently moving and transforming data