Back to list

Vacancy description

AI Augmented Data Engineer - ETL Pipelines in Chennai, भारत

Valam Solutions

Chennai, भारत

AI-Augmented Data EngineerRole : AI-Augmented Data EngineerEmployment Type : ContractualJob Summary :We are looking for an AI-Augmented Data Engineer to design, develop and maintain scalable data pipelines and infrastructure while leveraging AI-powered tools to improve engineering productivity and data processing https://jobeax.com/link/oKawmWwZiU9CLACB role focuses on building robust ETL/ELT pipelines, integrating data from multiple sources, optimizing data workflows and implementing automated data processing https://jobeax.com/link/5WM6jVJPxXxkaX5M ideal candidate should have strong expertise in Python, SQL, data engineering frameworks and cloud-based data platforms, along with practical experience using AI-assisted development tools to accelerate coding, debugging, documentation and pipeline https://jobeax.com/link/JQlli5hw40FS19iT Responsibilities :- Design, develop and maintain scalable data pipelines for processing structured and unstructured data.- Build and manage ETL/ELT workflows to extract, transform and load data from multiple sources.- Leverage AI-powered coding assistants to accelerate pipeline development, SQL generation, debugging and code optimization.- Validate and optimize AI-generated code to ensure data accuracy, reliability, security and maintainability.- Develop data transformation workflows using Python, SQL and modern data engineering frameworks.- Implement batch and real-time data processing solutions based on business requirements.- Build and maintain data integrations across APIs, databases, cloud storage and enterprise applications.- Develop and manage data workflows using orchestration tools such as Apache Airflow.- Work with data warehouses and lakehouse platforms to support analytics and reporting requirements.- Implement data quality checks, validation rules and monitoring mechanisms.- Optimize database queries, pipeline performance and resource utilization.- Collaborate with data scientists, AI engineers, analytics teams and software developers to support data requirements.- Implement data security, governance, access control and documentation standards.- Monitor pipeline execution, troubleshoot failures and resolve data inconsistencies.- Contribute to continuous improvement of data engineering practices through automation and AI-assisted https://jobeax.com/link/CvV7RRXRH5Irpfdu Skills & Qualifications:- Strong experience in Data Engineering, Data Pipeline Development or Data Platform Engineering.- Proficiency in Python and advanced SQL.- Hands-on experience developing ETL/ELT pipelines and data transformation workflows.- Practical experience using AI-assisted development tools for coding, debugging, documentation or query optimization.- Understanding of AI-generated code validation and responsible use of AI coding assistants in production environments.- Experience with Apache Airflow or similar workflow orchestration tools.- Strong understanding of data modelling, data warehousing and database concepts.- Experience working with relational and non-relational databases.- Knowledge of batch processing and real-time data processing concepts.- Experience integrating data through REST APIs and external data sources.- Understanding of data quality, data validation and pipeline monitoring.- Familiarity with Git, version control and CI/CD practices.- Knowledge of cloud-based data engineering environments.- Strong analytical, troubleshooting and problem-solving https://jobeax.com/link/Cexs453KRiH2S1rJ Skills :- Experience with Snowflake, Databricks, Google BigQuery or Amazon Redshift.- Familiarity with Apache Spark, PySpark and distributed data processing.- Knowledge of dbt for data transformation and modelling.- Exposure to Kafka or similar streaming technologies.- Experience with AWS, Microsoft Azure or Google Cloud Platform.- Familiarity with AI coding assistants such as GitHub Copilot, Cursor, Claude Code or equivalent tools.- Understanding of Generative AI and LLM-based developer productivity solutions.- Exposure to Docker, Kubernetes and containerized data workloads.- Knowledge of data governance, metadata management and data observability tools.- Familiarity with data lake and lakehouse https://jobeax.com/link/JJKfuHPEsmrFPG6l Skills :- Data Engineering, AI-Augmented Development, Python, SQL, ETL, ELT, Apache Airflow, Snowflake, dbt, Databricks, Apache Spark, PySpark, Data Pipelines, Data Modelling, Data Warehousing, Data Integration, REST APIs, Kafka, AWS, Azure, BigQuery, Git, CI/CD, GitHub Copilot, Cursor, Claude Code, Data Quality, Data Governance (ref:hirist.tech)

Similar vacancies

More like this role

  • Full-time
  • IT
  • QA
The ETL/Data QA Engineer will be responsible for ensuring the accuracy, reliability, and quality of data processed through the organisation's data warehousing and integration platforms. Operating within established testing and governance frameworks, the engineer will validate ETL processes, conduct detailed source-to-target ...

Pune, भारत

Intraedge Technologies Ltd.

Senior Data Engineer - ETL Pipelines

About the Role:We are looking for an experienced Senior Data Engineer with strong expertise in designing, developing, and optimizing enterprise-scale ETL/ELT pipelines and data integration https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities:- Design, develop, and maintain scalable ETL/ELT pipelines for extracting, ...

Pune, भारत

  • Full-time
... our customers to achieve the full potential of our industrial dataops platform.- Conduct code reviews and implement best practices to ensure high-quality and maintainable code and deliveries.- Support customers and partners in conducting data engineering tasks with Cognite products.- Contribute to the development of Cognite's ...

Bangalore, भारत

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

EPAM - Big Data Engineer - ETL/Databricks

  • Full-time
Position Details :Company : EPAMRole : Big Data Engineer / Databricks EngineerEmployment Type : Full-Time (FTE)Experience : 6 - 14 YearsLocation : GurgaonHiring Drive Date : 14 NovemberNotice Period : Immediate to 30 DaysMandatory Technical Skills :- Hands-on experience with Azure Databricks or AWS Databricks.- Strong expertise ...

Gurgaon, भारत

  • Remote
  • Contract
Data science contract role at ADV Techminds. Remote. What you'll do - Source: Salesforce (ECRM & OSC) - Build and maintain AWS data pipelines - Develop ETL/ELT pipelines using AWS Glue, PySpark, Python, and SQL What you need - AWS - ETL - SQL - Python - Redshift - Spark Good to have - DynamoDB - Terraform - IAM - Salesforce ...

Hyderabad, भारत

HiringBlaze

AI Data Engineer

  • Hybrid
... Responsibilities : - Vector & Graph ETL : Design and maintain pipelines that transform unstructured data (PDFs, emails, logs, chats) into optimized embeddings for Vector Databases (Pinecone, Weaviate, Milvus).- Semantic Data Modeling : Engineer data structures that optimize for Retrieval-Augmented Generation (RAG), ensuring agents ...

Hyderabad, भारत

IN06 Lonza India Systems

Senior AI Engineer / Developer

  • Full-time
  • AI / ML
... integrations, data pipelines - Apply and continuously refine prompting, model selection, and optimization techniques, leveraging LLM evaluation frameworks, Retrieval-Augmented Generation (RAG) What you need - Machine learning - LLMs - MLOps - Prompt engineering - CI/CD - Terraform Good to have - ETL - Test automation - Regression ...

Hyderabad, भारत

  • Full-time
  • IT

$14.68 USD

... Type: Full Time Position Description: We are looking for a Data Engineer with AI to join our team. The ideal candidate should have 1–4 years of experience in data warehousing, data engineering, or data warehouse operations. The role involves working with ETL tools such as Informatica PowerCenter, SSIS, DataStage, or Talend, ...

Bangalore, भारत

  • Contract
  • IT
... within. WHAT YOU'LL DO Software Engineer - Data & AI on the Proprietary Research team design and build Data & AI Platform to transform structured and unstructured data into actionable insights. As a member of our Data Engineering team, you will work closely with investment professionals, researchers, and data scientists to design, ...

Bangalore, भारत

  • Full-time
  • IT

$14.68 USD

... Time Position Description: We are looking for an experienced Data Engineer with AI to join our team. The ideal candidate should have 6–8 years of experience in data warehousing, data engineering, or data warehouse operations. The role involves supporting and leading data migration projects, working with ETL tools such as ...

Bangalore, भारत