2,501 big data python jobs in India.

... Java, JavaScript, or Python OR equivalent experience. Experience building scalable and highly available cloud services spanning multiple regions and/or clouds. Data modeling and big data processing experience Experience in work management and asset inventory systems #This position will be open for a minimum of 5 days, with ...

4300

... SQL Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark Data & AI - Data Engineering - Data Quality & Validation Data & AI - Data Engineering - Apache Kafka Big Data - Big Data - Azure databricks Data Science and Machine Learning - Data Science and Machine Learning - Python Data & AI - ETL ...

• On-site

... large-scale data platforms, with at least 2 years of experience leading or mentoring data engineers. - Hands-on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka. - Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses. - Extensive ...

... experience within Plan, make, source, deliver pillars of supply chain management is a plus - Data Analytics: Experience in working with large volumes of transactional data to develop segmentation and opportunity models (Must have- Power BI, Alteryx/SQL, MS Office applications; Good to have - Python/R, VBA, Snowflake/Databricks) ...

... practices. - Build and deploy AI/ML solutions in production environments to strengthen data controls, quality checks and risk detection across enterprise metadata and data management platforms. - Develop scalable microservices, RESTful APIs and event-driven solutions using Python frameworks such as Flask, FastAPI or Django, ...

... scalable ETL processes using big data technology Leverage large scale cloud infrastructure to build high throughput services Designing and implementing code in SQL/Python Good understanding and implementation experience in Data Governance, Data Quality, Data Modelling etc. Ensure projects are delivered on time and to the satisfaction ...

• Hybrid

... EventBridge, SQS, SNS, API Gateway, DynamoDB, Secrets Manager/Parameter Store, EC2 Instances, AppFlows, StepFunctions, Kinesis), React, Scripting Languages (Python, Shell, Kotlin), Databases (DynamoDB, PostGreSQL), Terraform, Serverless architecture,, Unit Testing Frameworks (JUnit, Mockito) - Experience working on latest ...

• Remote
• Contract

30k

... Erwin Data Modeler, Lucidchart, MySQL Workbench, and Oracle SQL Developer Data Modeler. Possess strong hands-on SQL and Python skills. Strong experience with data architecture principles, including data modelling, ETL/ELT processes, and data management and hands on experience with Big Data technologies. Familiarity with ...

• On-site

... software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and ...

... Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache ...

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

... models and scalable data engineering solutions across cloud and on‑premise ecosystems. The role requires deep expertise in conceptual, logical, and physical data modelling, semantic/ontology-based modelling, and modern data architecture patterns used in Data Warehouses, Data Lakes, Lakehouses, Big Data platforms, and Graph ...

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

... and building data pipelines.- Proficiency in AWS services, particularly S3, Glue, EMR, Lambda, and Redshift.- Strong programming skills in languages such as Python, Java, or Scala.- Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.- Docker, Kubernetes) and orchestration tools ...

Rs 15 - 25 lakhs p.a.

We are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in designing and implementing robust big data solutions that support our data-driven decision-making processes. Job description Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, ...

• Remote

... IST ~ Databricks, Pyspark, Python, SQL, Microsoft Fabric, Azure Data Factory, DataOps practices, and performance optimization We are looking for experienced Data Engineers with strong hands-on expertise in Databricks, PySpark, Python, SQL, and big data processing . The ideal candidate will have proven experience designing ...

Rs 15 - 25 lakhs p.a.

We are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in designing and implementing robust big data solutions that support our data-driven decision-making processes. Job description Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, ...

... identifies business trends and problems through complex big data analysis. Interprets results from multiple sources using a variety of techniques, ranging from simple data aggregation via statistical analysis to complex data mining independently. Prepares big data, implements data models, and develops database to support the business ...

... https://jobeax.com/link/qD1PXku8V3HtzrrZ :- Experience: 5+ years in data engineering, with deep data warehousing exposure at scale.- SQL and BigQuery: Expert-level SQL; hands-on BigQuery optimization (partitioning, clustering, slots, cost).- Data Modelling: Programming: Production-grade Python; PySpark on Dataproc (or Databricks/EMR equivalents).- ...

... scalable secure and high performance data platforms and architectures Lead the development of batch and real time data processing solutions using modern cloud and big data technologies Define data engineering standards best practices and governance frameworks Drive architectural decisions for data lakes lakehouses data warehouses ...