Lead Data Engineer SQL AWS in Bengaluru, India - Jobeax
Vacancy description
Lead Data Engineer SQL AWS in Bengaluru, India
JP Morgan Chase & Co.
India, Bengaluru
Lead Data Engineer SQL AWS in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorganChase within the Asset and Wealth Management, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm's business objectives. Job responsibilities
Make data available for AI and analytics initiatives, working closely with use case owners to define requirements, manage product dependencies, and support agile product routines that oversee cross-product data dependencies and prioritize delivery Collaborate with business, technology, and operations partners to understand data requests and accelerate provisioning through deployment of 'AI for Data' Provide transparency and drive executive visibility into bottlenecks, progress, performance metrics, and adoption tracking in making AI-ready and critical data sources available for innovation Drive insight into areas of efficiency and risk through consolidation and reengineering of data flows Lead data quality issue root cause analysis using deep data profiling and advanced analytics techniques, then fix the cause and embed uplifted evergreen controls to prevent future failures Develop proactive controls to reduce the time from data quality issue identification to resolution, improving client experience and driving operational efficiency through elimination of cost of poor quality (COPQ) Demonstrate control environment improvements and reduction in toil to achieve benefits through common tooling and frameworks. Uplift the metadata (semantic layer) of existing data ('Brownfield' enrichment) to support AI and Natural Language Query (NLQ) usage, accelerate adoption of Mesh data architecture, reduce consumer friction from poor catalog quality, and deliver data product prototypes that demonstrate the value of uplifted data assets Uses enterprise-authorized AI capabilities within the work environment to accelerate data platform and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements. Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations.
Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 5+ years applied experience Experience in strategic or transformational change initiatives, including data governance, data quality, or analytics transformation https://jobeax.com/link/LsX0MHwADPrlj8n9 technical skills in data profiling, analysis, and data management using modern tools and environments (Python, R, SQL, Spark, cloud platforms) Understanding of data lineage concepts and experience with lineage analysis, metadata management, and data cataloging Excellent communication skills with the ability to convey complex technical concepts to diverse audiences including executive leadership. Ability to work in a highly collaborative and intellectually challenging environment Willingness to challenge the status quo, think creatively, problem-solve, and drive innovation Experience with data quality frameworks, including profiling, rule development, issue remediation, and preventative controls Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity. Ability to review and validate AI-assisted outputs (e.g., model/design summaries or operational checklists) before use, escalating when uncertain and following data handling requirements. Strong proficiency in data science and analytics tools: Python, R, SQL, Spark, and cloud data platforms (AWS, Azure, GCP). Experience with data visualization and reporting tools (e.g., Tableau, Power BI) to deliver executive dashboards and performance metrics Preferred qualifications, capabilities, and skills Hands-on experience with data lineage tools and techniques, including graph databases and metadata management platforms. Knowledge of data governance frameworks, data quality dimensions, and regulatory requirements (e.g., BCBS 239, GDPR) Experience with AI/ML technologies and their application to data management challenges (e.g., automated data profiling, metadata enrichment). Understanding of agile and product management methodologies and experience working in agile teams Ability to multi-task in a fast-paced environment and operate independently with minimal https://jobeax.com/link/P7IbZBqM50jPDe9A judgment with the ability to balance strategic vision with pragmatic, incremental delivery Experience building and growing capabilities and developing talent in data science or data management teams Excellent interpersonal skills and ability to build strong working relationships with business, technology, and control stakeholders across global teams
... experiences. Contribute to AI-enabled features and use AI development tools responsibly to improve coding, testing, research, documentation, and delivery. Apply sound engineering practices across architecture, performance, security, testing, debugging, and maintainability. Deploy and operate services using AWS and CI/CD workflows, ...
... architects, analysts, developers, and business stakeholders to understand data requirements.- Ensure data quality, security, governance, and best practices across data engineering https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack:- Python, PySpark, SQL, AWS Glue, AWS Glue Data Catalog, AWS Lambda, Amazon S3, AWS Step Functions, ...
... in Python and SQL - Experience with Unity Catalog, cluster administration, and at least one major cloud platform (Azure, AWS, or GCP) - Solid understanding of data warehousing and dimensional modeling Databricks Certified Data Engineer (Associate or Professional) Cloud data engineering certification have minimum 5 years ...
... BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) ...
Hello, We are hiring for 'Data Engineer with Java' for Pune Location. Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline CI/CD SQL NOTE: We are looking for Immediate joiners(notice period ...
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to ...
... partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Lead Data Engineer Who is Mastercard Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital ...
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
... with enterprises to design, build, and operate cloud-native, AI-first systems that generate measurable business outcomes. Searce is a Google Cloud Global MSP, AWS Advanced Consulting Partner, Databricks Partner, and Anthropic Claude Partner. As a Lead SRE within the CSRE Delivery team, you will anchor reliability, scalability, ...
... Prometheus, Grafana, ELK, Datadog Agile Tools: Jira, Confluence Additional Expectations The candidate should be a strong team player leading a team with an ownership mindset, capable of independently managing AWS environments, automation frameworks, deployments, and collaborating with global engineering/customer teams.
... frameworks, or extensible platform systems. Backend https://jobeax.com/link/JSd7UYCSg572jJDY, Python, Java, Ruby Frontend React, TypeScript, Ant Design System, Figma AWS, Kubernetes (EKS), S3 Data MySQL, Snowflake, Aerospike, DynamoDB, ScyllaDB AI Tooling CI/CD, TDD, Agile, You Build It You Run It AI-native engineering culture ...
... proven track record of building and operating large-scale, distributed, API-driven systems in production. Expertise in observability, alerting, and reliability engineering , using tools such as Prometheus, Grafana, Datadog, Splunk, ELK, or equivalent ecosystems. Strong command of cloud platforms and open systems ( AWS, Azure, ...
... Department: Data Engineering / Product Engineering Role Overview We are looking for an experienced Data Engineer with 5–7 years of hands-on experience in ETL/ELT, database engineering, Big Data processing, and complex bi-directional data integrations . The candidate should have strong SQL and database expertise, experience working ...
... operations at ELGi. Data Engineering & Architecture Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks for ingestion, transformation, and orchestration. Build Spark, SQL, and Python workflows in Databricks. Optimize compute, storage, and ...
... least one certification • Databricks Certified Data Engineer Associate OR Databricks Certified Data Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud ...
... maintain scalable data pipelines and distributed systems. The ideal candidate should have hands-on experience with ETL/ELT pipelines, workflow orchestration, AWS cloud services, data visualization, distributed architectures, and modern data engineering https://jobeax.com/link/TtkK7BHPbancvnFq Responsibilities:- Design, ...
... using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks Build and manage AWS-native data workflows using S3, Glue, Lambda, Redshift, and Step Functions; ...
... Senior Data Engineer with strong hands-on experience building and supporting data solutions on AWS . The role requires solid experience with Amazon Redshift, S3, AWS Glue, Amazon AppFlow, Lambda, and SQL . You will work on data ingestion, transformation, data pipelines, data warehouse solutions, and integrations across different ...