Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview : We are looking for a Data Engineer with strong hands-on experience in Python, SQL, and Spark to build and maintain scalable data pipelines and integration solutions. The ideal candidate should have experience with Azure data technologies and ETL/ELT https://jobeax.com/link/OfTNakiwtq51n9YB Responsibilities : - Develop and maintain scalable data pipelines using Python, SQL, and Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, and pipelines for performance and scalability.- Perform data validation, quality checks, and troubleshooting of pipeline failures.- Monitor data pipelines and resolve issues across development and production environments.- Collaborate with data scientists, analysts, and technology teams to deliver data https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack & Requirements : - Strong proficiency in Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- Strong troubleshooting and analytical skills.- Good understanding of cloud-based data platforms. (ref:hirist.tech)
... of SQL , including: Basic understanding of relational databases such as PostgreSQL or MySQL . Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience. - 0–2 years of experience in Python/backend development. - Fresh graduates with relevant projects, ...
Role Overview : We are seeking a seasoned AI Engineer to join our innovation hub in Gurgaon. - In this role, you will architect and deploy sophisticated machine learning models that transform complex datasets into actionable business intelligence. - You will collaborate closely with cross-functional product teams, data ...
... Provide clarity on risks, constraints, priorities, and delivery strategies. Ability to move from need problem capability solution implementation . Software Engineering & Architecture Strong software engineering experience in Python, TypeScript, Java, or equivalent technologies. Experience designing and developing distributed ...
... rest of the company's data stack runs on. - Write and maintain internal Python libraries (including shared Airflow operators and frameworks) consumed by other engineering teams. - Build and operate Temporal-based workflow systems for long-running, reliable distributed data workflows. - Build internal data platform applications, ...
... & Data Platform. You’ll design and maintain reliable, secure, and scalable data pipelines and models that power a new generation of reporting, insights, and data-driven products across the StarRez ecosystem. This role sits at the intersection of data, product, and engineering. You will work closely with Data Analysts, ...
Data Engineer – Python & Pyspark (AWS) Exp: 6+ yrs Location : Chennai Client Place Guindy Work Mode : All 5 days Role Overview We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You ...
... checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience - Proven production data engineering experience at scale - Strong Python and SQL skills - Deep analytical warehouse ...
... Computer Science, Information Technology, Engineering, or related field. - 8+ years of experience in Devops and 3+ years in DBX. - Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow). - Proficiency in SQL and programming languages like Python or Scala. - Experience with Azure cloud data services. ...
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
... Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object ...
... and monitor ETL/ELT pipelines using Apache Airflow. Programming: Proficiency in Python or Java for data processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; working ...
... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
... technical skills to optimize data delivery and reduce costs Responsible to mentor Data Engineers at all levels of experience Advanced experience with Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, Power BI, SSIS or other cloud-based data systems Advanced experience with Azure ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
... Azure-based data pipelines, including: - Azure Data Factory / Synapse - DataBricks / Synapse Spark Pool - Cosmos DB - Azure Data Lake Storage (ADLS) - Dedicated SQL Pool / Azure SQL - Azure Logic Apps - Hands-on experience with data transformation and cleansing using Spark, Python, R, SQL - Strong understanding of CI/CD, ...
... Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration Python PySpark Strong SQL and data engineering fundamentals hands-on experience in GCP-based data platforms.
... end-to-end ML workflows from data ingestion to model https://jobeax.com/link/6K228mqDEvef9KNC Qualifications & Skills :- 2 to 4 years of experience in AI/ML engineering or data science roles.- Proficiency in Python, especially for ML development.- Hands-on experience with TensorFlow, PyTorch, or similar ML frameworks.- Exposure ...
... maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline design patterns - PySpark: Proven hands-on experience developing data pipelines using PySpark, including DataFrames API, Spark SQL, and performance optimization ...