Data Integration Engineer - ETL/SQL in Bengaluru, India - Jobeax
Vacancy description
Data Integration Engineer - ETL/SQL in Bengaluru, India
A client of People Impact
India, Bengaluru
Data Integration Engineer - ETL/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, batch pipelines, reconciliation, production support, and audit-ready https://jobeax.com/link/0tczEVIPDdr4h8mr Have :- Strong experience developing data integration, ETL/ELT, batch processing, and scheduled data delivery solutions.- Proficiency in SQL and experience working with enterprise data sources, file-based integrations, and analytics platforms.- Ability to analyze source-system structures and implement source-to-target mappings and transformation logic.- Experience with data quality validation, reconciliation, exception handling, and root-cause analysis.- Experience supporting SIT, UAT, production deployments, and defect resolution.- Ability to create interface specifications, mapping documents, transformation rules, and operational support procedures.- Strong collaboration skills across Business Analysts, Product Owners, data owners, vendors, Scrum Masters, and engineering teams.- Experience working in Agile delivery environments.Good-To-Have Skills:- Experience with financial services data, including brokerage, wealth management, cash management, deposits, or banking.- Experience performing financial data reconciliation and validation.- Understanding of data governance, auditability, security, and regulatory controls for financial data.- Experience monitoring production jobs and supporting time-sensitive data https://jobeax.com/link/q6mT8MCfo9RISiNs Responsibilities:- Design, develop, test, and maintain integrations that extract financial and operational data from enterprise source systems.- Analyze source structures and collaborate with Business Analysts to define mappings, transformations, validations, and business rules.- Develop automated extraction, transformation, validation, reconciliation, and file-generation processes.- Build and maintain reliable scheduled batch jobs and recurring data pipelines.- Implement data quality checks, control totals, exception handling, and reconciliation processes.- Work with stakeholders, data owners, and vendor teams to validate source data, file formats, mappings, and integration requirements.- Support SIT, UAT, production deployment, and data-output validation; investigate and resolve defects.- Troubleshoot discrepancies, perform root-cause analysis, and implement corrective and preventive actions.- Optimize data extraction and transformation processes for performance, scalability, and reliability.- Monitor production jobs, investigate failures, and ensure timely delivery of data https://jobeax.com/link/nZRXbBOR1WK8A6WZ Qualifications / Good to Have:- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related discipline.- Relevant experience in place of formal education may be considered.- Financial services integration experience is strongly preferred. (ref:hirist.tech)
... maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline design patterns - PySpark: Proven hands-on experience developing data pipelines using PySpark, including DataFrames API, Spark SQL, and performance optimization ...
... JavaScript and LWC Expertise in backend development using Apex, Flows, Async Apex Understanding of Database concepts: SOQL, SOSL and SQL Hands-on experience in API integration using SOAP, REST API, graphql Experience with ETL tools , Data migration, and Data governance Experience with Apex Design Patterns, Integration Patterns and ...
... Dicer data exploration and analytics Epic data models and reporting architecture Data & Analytics Strong SQL development skills Data analysis and troubleshooting ETL and data integration concepts Data quality validation and reconciliation Required Certifications Epic Cogito Certification PL-300: Microsoft Power BI Data Analyst ...
... (Kafka, RabbitMQ) Preferred. Nice To Have : Hands-on expertise in Automic (Job Scheduling) Experience with Grafana , OpenSearch and Ansible Understanding of data governance and data quality frameworks. Experience with Oracle Database programming with PL/SQL Certificate Experience in Informatica Power Center ( ETL Process) ...
... look for opportunities to streamline processes with an eye towards building a repeatable model to reduce implementation duration. Job Requirements: • The CDP ETL & Database Engineer will be well versed in the following areas: Relational data modeling ETL and FTP concepts Advanced Analytics using SQL Functions Cloud technologies ...
... with Delta Lake features: MERGE, CDC, time travel, schema enforcement Data Engineering & Development Strong Python and SQL programming skills Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data models Experience integrating complex data sources: Oracle DB, SQL Server, Azure ...
... understanding of SQL, data integration, data quality, and reporting https://jobeax.com/link/UuxHBYkbQjke5gQz candidate will work closely with business analysts, data engineers, reporting teams, and business stakeholders to understand data requirements and deliver scalable, reusable, and automated data https://jobeax.com/link/XnflZD2dGSZYgXFG ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
... Responsibilities Design, build, and maintain scalable ETL/ELT pipelines using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks Build and manage AWS-native ...
... data quality checks to support business needs and demonstrate ownership of live data pipelines. Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance. Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging Optimize ETL ...
... Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines to integrate structured, semi-structured, and unstructured data from multiple sources Implement ETL/ELT processes ...
... definitions and Data Quality Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python ...
... Data Migration. Proven expertise with Guidewire Data Migration Framework, Mammoth ETL, and related Guidewire tools. Strong knowledge of Guidewire PolicyCenter data model and its integration with external legacy systems. Proficiency in SQL, PL/SQL, and data transformation scripting (Python, Java, or Groovy preferred). Hands-on ...
... subject matter expert in SQL and database performance. What You Will Do As A Data Warehouse Engineer Build and monitor robust ETL/ELT pipelines using BigQuery, Dataflow, and Cloud Composer. Expert SQL Execution: Develop high-performance SQL scripts for complex data transformations, ensuring accuracy across multiple datasets. ...
... design and implement automated data pipelines and materialized views. - Proficiency in Python, Unix or similar languages. - Good understanding of SQL oracle, SQL server or similar languages. - Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions). - Core Engineering: Data structures/algorithms, ...
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
... integrate data solutions into the overall architecture. Previous experience in Data Engineering, we're looking for around 3-7 years worth of experience. Strong SQL skills and experience working with relational databases such as Snowflake, PostgreSQL, or MySQL. Experience building and maintaining data pipelines and ETL workflows ...
... dashboarding use cases What we’re looking for Strong experience as a Data Engineer in Azure environments Hands-on with tools such as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience Experience building ETL/ELT pipelines for analytics workloads Understanding of data modelling ...
... strong SAP source-system integration experience for customer and/or material master data. Experience with graph modeling, Snowflake Cortex AI, and Salesforce integration is highly desirable across the team but is not required for both resources. The combined team should provide broad coverage across data engineering, data ...
... in Python and SQL - Experience with Unity Catalog, cluster administration, and at least one major cloud platform (Azure, AWS, or GCP) - Solid understanding of data warehousing and dimensional modeling Databricks Certified Data Engineer (Associate or Professional) Cloud data engineering certification have minimum 5 years ...