Data Analytics Engineer SQL in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Roles and Responsibilities Architect and maintain enterprise-grade ELT and ETL data pipelines using Python, PySpark, Kafka, and Databricks to manage large-scale risk data. Build and deploy GenAI agents utilizing Google ADK, Google Flash 2.5+ LLMs, and Model Context Protocol (MCP) integrated with Human-in-the-Loop workflows. Design, automate, and deploy microservice integrations for data-intensive applications on OpenShift and Kubernetes using robust CI/CD pipelines. Implement data federation layers supporting Lambda and Data Mesh architectures via Starburst to enable AI/ML and NLP use cases. Leverage agentic AI platforms and development assistants such as https://jobeax.com/link/FLl2iJ9Ts45AZ1a3 and GitHub Copilot with prompt engineering to increase engineering velocity. Enforce data governance, risk management policies, and regulatory compliance standards across all data platforms.
Preferred Candidate Profile Work Experience: 8+ years in large-scale application development with 5+ years in a Python and PySpark Data Engineering lead role. Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree preferred). Core Technical Skills: Python, PySpark, Databricks, Google ADK, LLMs, FastAPI, Spring Boot, Microservices, Kafka, SQL, Data Mesh, Starburst. Infrastructure and Cloud: Kubernetes, OpenShift, Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
... data integration, validation, troubleshooting, and performance optimization. Collaborate with functional, technical, and business teams to deliver end-to-end analytics solutions. Provide production support, documentation, and knowledge transfer. Preferred skills: SAP BW/BW4HANA, SAC, HANA, data modeling, reporting, SQL, and ...
Job Summary :We are looking for an experienced SAP Datasphere Consultant with strong expertise in data modeling, data integration, analytics, and SAP cloud data solutions. The ideal candidate should have hands-on experience with SAP Datasphere, SAP HANA Cloud, data modeling, data flows, replication flows, SQL, and SAP Analytics ...
... datasets. Work with PostgreSQL databases for structured data management and optimization. Develop APIs and backend services using FastAPI. Integrate multiple data sources and ensure data consistency and quality. Collaborate with cross-functional teams for analytics, reporting, and business intelligence solutions. Optimize ...
... monitoring, and error-handling processes. Troubleshoot data pipeline failures, SQL issues, and Redshift performance problems. Work with business, reporting, analytics, and application teams to understand data requirements and provide appropriate solutions. Follow data security, governance, and engineering best practices. ...
Data Engineering at Blackbaud is responsible for ingestion, transformation and processing of data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed ...
... (Bronze/Silver/Gold) data architectures that balance performance, cost, and usability Use AI-assisted tools to accelerate development — generating boilerplate code, drafting SQL/dbt models, writing documentation, debugging pipeline failures, and summarising data quality issues Partner with data quality, governance, and analytics teams ...
... experience with data visualization techniques and can communicate the insights as per the audience. You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems. You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). ...
... platforms. The role requires strong hands-on experience across SQL Server, Azure Data Factory, Azure Data Lake, Microsoft Fabric, Logic Apps,Power BI, GitHub, and Data Modeling. Required Skills: - 10+ years of Software Engineering / Data Engineering experience. - Strong SQL Server and T-SQL expertise. - Strong experience working ...
... checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience - Proven production data engineering experience at scale - Strong Python and SQL skills - Deep analytical warehouse ...
... Computer Science, Information Technology, Engineering, or related field. - 8+ years of experience in Devops and 3+ years in DBX. - Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow). - Proficiency in SQL and programming languages like Python or Scala. - Experience with Azure cloud data services. ...
... Sentinel and Governed Analytics. Manage agent state and memory persistence using Databricks-native storage (Delta Lake, Unity Catalog) and integrate with external databases (CosmosDB, Neo4j) as required by agent workflows. Collaborate with AI Engineers on agent architecture decisions and ensure all agentic workloads meet latency ...
... assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Develop high ...
... processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; working knowledge of NoSQL databases like MongoDB or Firestore. Version Control & DevOps: Experience with Git, CI/CD ...
... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
... Engineer Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. Data Engineer is responsible ...
... applications and fundamental data that support Portfolio Management groups in managing risk and PnL. The team develops and supports next-generation in-house risk and analytics tools across risk, analytics, trading, portfolio visualization, and market data. Monitor and automate application, infrastructure, and cloud alerts, responding ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
... governance. Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other ...
... - A degree in engineering - 3–6 years in a technical, customer-facing role — Technical Account Management, Solutions Consulting, Implementation Consulting, Analytics Consulting, or similar - Strong SQL and experience working with large, messy datasets - Excellent written and verbal English — you'll be in daily contact with ...