Back to list

Vacancy description

Data Quality Engineer in Chennai, भारत

Valam Solutions

Chennai, भारत

Job Title: Data Quality Engineer

Location: Chennai, India (Offshore)
Experience: 5–8+ Years (Preferred)
Joining: Immediate Joiners Only

Job Summary

We are looking for an experienced Data Quality Engineer with strong expertise in SQL, Databricks, data quality frameworks, ETL/ELT pipelines, and data observability. The ideal candidate will be responsible for ensuring the accuracy, consistency, completeness, reliability, and integrity of enterprise data across cloud-based data platforms.

The candidate will work closely with Data Engineers, Data Architects, Data Governance teams, and business stakeholders to implement data quality validation frameworks, monitor data pipelines, identify data anomalies, and resolve data-related issues. Hands-on experience with Monte Carlo Data Observability, Azure data platforms, and Collibra is highly preferred.

Key Responsibilities1. Data Quality Engineering

  • Design, develop, and implement comprehensive data quality validation frameworks for enterprise data platforms.

  • Define and implement data quality rules to validate data accuracy, completeness, consistency, uniqueness, and timeliness.

  • Perform data profiling, cleansing, reconciliation, and validation across large datasets.

  • Identify data anomalies, inconsistencies, duplication, missing values, and integrity issues.

  • Develop automated data quality checks and validation processes.

  • Monitor data quality metrics and generate reports to support business and technical stakeholders.

  • Investigate data quality incidents and perform root cause analysis.

  • Collaborate with Data Engineering teams to resolve data quality issues across data pipelines.

2. SQL & Database Management

  • Develop and optimize complex SQL queries for data validation, profiling, reconciliation, and analysis.

  • Work with large datasets across relational and NoSQL databases.

  • Perform source-to-target data validation and reconciliation.

  • Validate database transformations and business logic.

  • Analyze query performance and optimize SQL scripts for efficient execution.

  • Work with structured and semi-structured data formats.

3. Databricks & Data Engineering

  • Perform data quality validation using Databricks environments.

  • Work with Databricks notebooks, Spark SQL, and distributed data processing.

  • Validate batch and near-real-time data processing pipelines.

  • Monitor ETL/ELT workflows and ensure data accuracy throughout the processing lifecycle.

  • Collaborate with Data Engineers to implement quality checks within data pipelines.

  • Work with Azure cloud-based data platforms and lakehouse architectures.

  • Validate data transformations across data lakes, data warehouses, and lakehouse environments.

4. Monte Carlo Data Observability

  • Implement and maintain data observability monitoring using Monte Carlo.

  • Monitor data pipelines, datasets, and critical data assets for anomalies.

  • Configure data quality alerts, monitoring rules, and observability metrics.

  • Identify unexpected changes in data volume, freshness, schema, and distribution.

  • Investigate data incidents and support root cause analysis.

  • Ensure timely detection and resolution of data reliability issues.

  • Collaborate with data platform teams to improve observability coverage.

5. Data Governance & Metadata Management

  • Work with Collibra for data cataloging, metadata management, and data governance activities.

  • Support data lineage and data asset documentation.

  • Ensure data quality standards align with enterprise governance policies.

  • Maintain data quality rules, metadata definitions, and business glossary information.

  • Collaborate with Data Governance teams to establish data quality standards and controls.

6. Data Modeling & Architecture

  • Understand data warehouse, data lake, and lakehouse architectures.

  • Work with dimensional data models, relational data models, and enterprise data structures.

  • Validate data across fact tables, dimension tables, and data marts.

  • Support data integration and transformation processes.

  • Ensure data consistency across multiple data sources and target systems.

7. Collaboration & Reporting

  • Collaborate with Data Engineers, Data Architects, Data Analysts, and Business stakeholders.

  • Document data quality issues, validation results, and remediation activities.

  • Participate in Agile development, sprint planning, and technical discussions.

  • Prepare data quality dashboards, reports, and metrics.

  • Support regulatory and compliance-related data quality requirements.

Mandatory Technical Skills

  • Strong SQL and database querying skills.

  • Hands-on experience with Databricks.

  • Experience in Data Quality Engineering and data validation.

  • Hands-on experience with Monte Carlo Data Observability.

  • Experience with ETL/ELT pipelines and data integration.

  • Experience with relational and NoSQL databases.

  • Familiarity with Microsoft Azure data platforms.

  • Knowledge of data warehouses, data lakes, and lakehouse architectures.

  • Understanding of batch and near-real-time data processing.

  • Familiarity with Collibra and data governance concepts.

Good to Have Skills

  • Programming experience in Python, Scala, or Java.

  • Experience with Apache Spark and PySpark.

  • Knowledge of orchestration tools such as Airflow or Control-M.

  • Experience with data lineage, metadata management, and data cataloging.

  • Exposure to banking, financial services, or regulatory environments.

  • Knowledge of CDMP, Azure, or AWS certifications.

  • Experience with automated data quality testing frameworks.

Candidate Profile

  • Strong analytical and problem-solving skills.

  • Excellent understanding of data quality concepts and data engineering practices.

  • Ability to work with large-scale enterprise data environments.

  • Strong communication and collaboration skills.

  • Ability to troubleshoot complex data issues independently.

  • Immediate availability to join.

  • Willingness to attend the Chennai office a couple of days per week during the initial months.

Preferred Candidate: Data Quality Engineer / Data Quality Analyst / Data Observability Engineer with strong SQL, Databricks, Monte Carlo, ETL/ELT, and Azure experience.

Similar vacancies

More like this role

Persistent Systems

Data Quality Engineer

... initiatives for data governance and testing standards. Expertise Youll Bring: - 610 years of experience in Data Quality Engineering ETL Testing Data Validation or QA Engineering. - Strong experience in Data Quality Management and Data Validation processes. - Expertise in ETL Testing Data Warehouse Testing and Data Integration validation. ...

Pune, भारत

GK HR Consulting India Private Limited

Data Quality Engineer

... Budget 339 Senior Data Analyst SQL Snowflake Medallion (Bronze Silver Gold) Power BI or Tableau Python 1 Hyderabad 6Yrs Divya 28 LPA 348 Data Quality Engineer (Data QE) PostgreSQL Microsoft SQL Server (MSSQL) Snowflake BigQuery Medallion Architecture ETL Quality Testing 1 Hyderabad 6Yrs Divya 28 LPA 350 Quality Engineer Java ...

Hyderabad, भारत

... maintain automated data quality testing suites to monitor system health proactively. Requirements Requirements: - Minimum of 6 years of professional experience in data engineering or quality assurance within the IT Services sector. - Proven expertise in ETL testing data validation methodologies and reconciliation techniques. ...

Hyderabad, भारत

... a highly motivated Data Quality Engineer to join our data engineering team. The ideal candidate will be responsible for building and maintaining robust data quality frameworks to ensure the accuracy, consistency, and reliability of data across platforms. You will collaborate with cross-functional teams to embed quality ...

Pune, भारत

Appzlogic Mobility solutions Pvt. Ltd. ,Noida

Appzlogic - Senior Data Quality Engineer - Tosca DI

  • Remote
  • Full-time
Senior Data Quality Engineer - Tosca DI (Data Integrity)Experience: 6+ YearsLocation: Remote, IndiaWork Mode: Permanent RemoteShift: 2:00 PM - 11:00 PM ISTRole Overview:We are looking for an experienced Senior Data Quality Engineer with strong, hands-on expertise in Tricentis Tosca Data Integrity (DI) to support enterprise-level ...

भारत

  • Remote
  • Hybrid
... tools (DataHub) to trace, prioritize, and resolve data quality issues. • Provide technical guidance and mentoring to data quality engineers and collaborate with data governance and engineering teams. What you’ll need to succeed • Minimum 5 years of experience in data quality engineering or data engineering. • Strong SQL and ...

Bangalore, भारत

  • Full-time
... TO HAVE) Databricks Certified Data Engineer Associate DAMA Certified Data Management Professional (CDMP) EXPERIENCE AND QUALIFICATIONS 4 to 5 years in data engineering or data quality roles Built data quality or reconciliation controls on a cloud data platform Experience with finance or banking data Degree in engineering ...

Bangalore, भारत

  • QA
... automation tools/frameworks • Understanding of approaches used to identify, prioritize, and mitigate risks to reduce or eliminate potential threats to software quality • Understanding of the flow of data through systems and the ability to analyze databases through RDBMS queries (SQL) • Awareness of regulatory requirements ...

Bangalore, भारत

Vrinda International

QUALITY ENGINEER

... identify track and resolve defects throughout the software lifecycle. Requirements Requirements: - Possess a minimum of six years of professional experience in quality engineering within the IT sector. - Demonstrate strong proficiency in SQL for database querying and data validation. - Exhibit extensive hands-on experience ...

Hyderabad, भारत

Accenture in India

Quality Engineer

**Project Role :** Quality Engineer **Project Role Description :** Enables full stack solutions through multi-disciplinary team planning and ecosystem integration to accelerate delivery and drive quality across the application lifecycle. Performs continuous testing for security API and regression suite. Creates automation ...

Bangalore, भारत