Data Integration Engineer - ETL/SQL in Bengaluru, India - Jobeax
Vacancy description
Data Integration Engineer - ETL/SQL in Bengaluru, India
A client of People Impact
India, Bengaluru
Data Integration Engineer - ETL/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, batch pipelines, reconciliation, production support, and audit-ready https://jobeax.com/link/0tczEVIPDdr4h8mr Have :- Strong experience developing data integration, ETL/ELT, batch processing, and scheduled data delivery solutions.- Proficiency in SQL and experience working with enterprise data sources, file-based integrations, and analytics platforms.- Ability to analyze source-system structures and implement source-to-target mappings and transformation logic.- Experience with data quality validation, reconciliation, exception handling, and root-cause analysis.- Experience supporting SIT, UAT, production deployments, and defect resolution.- Ability to create interface specifications, mapping documents, transformation rules, and operational support procedures.- Strong collaboration skills across Business Analysts, Product Owners, data owners, vendors, Scrum Masters, and engineering teams.- Experience working in Agile delivery environments.Good-To-Have Skills:- Experience with financial services data, including brokerage, wealth management, cash management, deposits, or banking.- Experience performing financial data reconciliation and validation.- Understanding of data governance, auditability, security, and regulatory controls for financial data.- Experience monitoring production jobs and supporting time-sensitive data https://jobeax.com/link/q6mT8MCfo9RISiNs Responsibilities:- Design, develop, test, and maintain integrations that extract financial and operational data from enterprise source systems.- Analyze source structures and collaborate with Business Analysts to define mappings, transformations, validations, and business rules.- Develop automated extraction, transformation, validation, reconciliation, and file-generation processes.- Build and maintain reliable scheduled batch jobs and recurring data pipelines.- Implement data quality checks, control totals, exception handling, and reconciliation processes.- Work with stakeholders, data owners, and vendor teams to validate source data, file formats, mappings, and integration requirements.- Support SIT, UAT, production deployment, and data-output validation; investigate and resolve defects.- Troubleshoot discrepancies, perform root-cause analysis, and implement corrective and preventive actions.- Optimize data extraction and transformation processes for performance, scalability, and reliability.- Monitor production jobs, investigate failures, and ensure timely delivery of data https://jobeax.com/link/nZRXbBOR1WK8A6WZ Qualifications / Good to Have:- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related discipline.- Relevant experience in place of formal education may be considered.- Financial services integration experience is strongly preferred. (ref:hirist.tech)
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... requirements Experience: 8+ years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: ...
... architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who ...
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
Job Description: We are looking for a skilled Python SQL and ETL Developer to design build and maintain scalable data pipelines and data integration solutions The ideal candidate will work closely with data engineers analysts and business stakeholders to ensure reliable high quality data delivery for reporting analytics ...
... collaborating with global teams is highly preferred). Experience working in cross-functional and cross-Business-Group environments. Basic SQL knowledge. Basic ETL knowledge (Alteryx and/or KNIME). Basic Microsoft Power Automate skills. Basic Bosch Digital File Service knowledge. Understanding of data interfaces, data validation, ...
... adherence to Jira Hygiene practices. Use GitHub and GitHub Actions for version control and continuous integration/continuous deployment (CI/CD) processes. Work with SQL databases and Linux environments to support testing activities. Apply basic ETL knowledge to validate data transformations and integrations. Language: Java, Typescript, ...
... interactive dashboards and reports in Tableau and Power BI. Develop efficient SQL queries and data models in Snowflake for analytics and visualization. Ensure data accuracy, performance optimization, and visualization best practices. Work closely with data engineering to ensure smooth data integration and pipeline readiness. ...
... KPIs, and calculated columns optimized for high-frequency telemetry datasets.- ETL & Data Integration: Create robust ETL workflows and integrate Power BI with SQL Server, Azure SQL, REST APIs, and enterprise data sources.- Governance & Maintenance: Implement Row-Level Security (RLS), manage dataset refreshes, and maintain ...
... solutions. Ensure data quality, performance, reliability, and scalability. Required Skills: - 7+ years of Data Engineering experience. - Strong experience in Data Modeling, Data Warehousing, and ETL development. - Proficiency in Python, Java, Scala, or NodeJS. - 3+ years of SQL experience. - Experience building and operating ...
... the Role:We are looking for an experienced AWS Data Engineer with 6 - 8 years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions on AWS. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS data services, with experience building robust ETL pipelines ...
... maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline design patterns - PySpark: Proven hands-on experience developing data pipelines using PySpark, including DataFrames API, Spark SQL, and performance optimization ...
... JavaScript and LWC Expertise in backend development using Apex, Flows, Async Apex Understanding of Database concepts: SOQL, SOSL and SQL Hands-on experience in API integration using SOAP, REST API, graphql Experience with ETL tools , Data migration, and Data governance Experience with Apex Design Patterns, Integration Patterns and ...
... look for opportunities to streamline processes with an eye towards building a repeatable model to reduce implementation duration. Job Requirements: • The CDP ETL & Database Engineer will be well versed in the following areas: Relational data modeling ETL and FTP concepts Advanced Analytics using SQL Functions Cloud technologies ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
... model outcomes, and business impact to senior stakeholders.- Manage expectations, timelines, dependencies, and delivery priorities across multiple initiatives.5. Data Science Engineering & Deployment:- Collaborate with engineering teams to productionize machine learning models and analytical solutions.- Promote scalable ML ...
... Responsibilities Design, build, and maintain scalable ETL/ELT pipelines using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks Build and manage AWS-native ...
... design and implement automated data pipelines and materialized views. - Proficiency in Python, Unix or similar languages. - Good understanding of SQL oracle, SQL server or similar languages. - Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions). - Core Engineering: Data structures/algorithms, ...