Data Analytics Engineer SQL in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Roles and Responsibilities Architect and maintain enterprise-grade ELT and ETL data pipelines using Python, PySpark, Kafka, and Databricks to manage large-scale risk data. Build and deploy GenAI agents utilizing Google ADK, Google Flash 2.5+ LLMs, and Model Context Protocol (MCP) integrated with Human-in-the-Loop workflows. Design, automate, and deploy microservice integrations for data-intensive applications on OpenShift and Kubernetes using robust CI/CD pipelines. Implement data federation layers supporting Lambda and Data Mesh architectures via Starburst to enable AI/ML and NLP use cases. Leverage agentic AI platforms and development assistants such as https://jobeax.com/link/FLl2iJ9Ts45AZ1a3 and GitHub Copilot with prompt engineering to increase engineering velocity. Enforce data governance, risk management policies, and regulatory compliance standards across all data platforms.
Preferred Candidate Profile Work Experience: 8+ years in large-scale application development with 5+ years in a Python and PySpark Data Engineering lead role. Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree preferred). Core Technical Skills: Python, PySpark, Databricks, Google ADK, LLMs, FastAPI, Spring Boot, Microservices, Kafka, SQL, Data Mesh, Starburst. Infrastructure and Cloud: Kubernetes, OpenShift, Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
... real-time decisioning. Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems. Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Comfortable with SQL and a transformation framework (e.g., Familiarity with ...
... Bachelor's degree (preferably in Computer Science, Mathematics, Data Science, or a related field). - 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted ...
... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...
... Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing ...
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
We are looking for a Data Engineer to join our team and play a key role in building, optimizing, and managing data pipelines. You will work closely with Data Analysts and Business Functions to ensure seamless data processing, reporting, and dashboarding. Our tech stack includes BigQuery, Snowflake, Airflow, Stitch/Fivetran, ...
... Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- ...
... experience with Python, SQL, and PySpark. Strong understanding of unit testing, test automation, debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, ...
... Bachelor/Master's Degree with 4+ years of experience across Data Engineering (Data Pipelining, Warehousing, ETL Tools etc.) Extensive hands-on experience with data engineering techniques and Python & SQL Strong working knowledge of Snowflake, Airflow and dbt You are comfortable and have expertise in data engineering tooling ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming ...
... Bachelor/Master's Degree with 4+ years of experience across Data Engineering (Data Pipelining, Warehousing, ETL Tools etc.) Extensive hands-on experience with data engineering techniques and Python & SQL Strong working knowledge of Snowflake, Airflow and dbt You are comfortable and have expertise in data engineering tooling ...
... work Bachelor's degree or higher in Computer Science, Data Engineering, or a related field (or equivalent professional experience) - 3+ years of experience in data engineering, analytics engineering, or a similar data-focused role - Strong SQL skills, including schema design for data warehouse or data lake use cases - Proficiency ...
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
... https://jobeax.com/link/TEtw0SgP3UR1RgAh : Senior Data https://jobeax.com/link/gTHUyXDKJ42uWexF are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, and own end-to-end production data pipelines powering analytics and business https://jobeax.com/link/31g3t2QRSRYuSEHD ...
... - 1+ years of experience in relational and dimensional data modeling using SQL Server and data warehousing concepts. - Must have 2+ years of experience with T-SQL , stored procedures, and performance tuning. - 2+ years of experience with Azure Data Factory , Azure Data Lake , Azure SQL DB , and Azure Synapse Analytics . ...