2,482 big data python jobs in India.

• On-site

5k

... or Other) - Advanced experience and hands-on architecture and administration experience on big data platforms - Data Warehouse Appliances, Hadoop (AWS EMR), Data Lake Technologies (AWS S3/GCS/Other) and experience with ML and Data Science platforms (Spark ML , H2O , KNIME ) - Python, Java, Scala - DevOps, Continuous Delivery, ...

... complex business needs. Ensure the highest levels of data quality and integrity through rigorous data validation and cleansing processes. Collaborate closely with data scientists and analysts to provide clean, structured data for advanced analytics and machine learning models. Oversee and manage big data technologies and frameworks, ...

... Familiarity with Airflow or workflow orchestration tools Knowledge of Python / PySpark Understanding of data lake architectures Qualifications - Bachelor's or Master's degree in Computer Science, Engineering, or related field - 5–8 years of relevant experience in Big Data technologies Skills: hadoop,big data,spark,sql,scala

4300

... SQL Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark Data & AI - Data Engineering - Data Quality & Validation Data & AI - Data Engineering - Apache Kafka Big Data - Big Data - Azure databricks Data Science and Machine Learning - Data Science and Machine Learning - Python Data & AI - ETL ...

... Java, JavaScript, or Python OR equivalent experience. Experience building scalable and highly available cloud services spanning multiple regions and/or clouds. Data modeling and big data processing experience Experience in work management and asset inventory systems #This position will be open for a minimum of 5 days, with ...

• On-site

... large-scale data platforms, with at least 2 years of experience leading or mentoring data engineers. - Hands-on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka. - Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses. - Extensive ...

... experience within Plan, make, source, deliver pillars of supply chain management is a plus - Data Analytics: Experience in working with large volumes of transactional data to develop segmentation and opportunity models (Must have- Power BI, Alteryx/SQL, MS Office applications; Good to have - Python/R, VBA, Snowflake/Databricks) ...

... practices. - Build and deploy AI/ML solutions in production environments to strengthen data controls, quality checks and risk detection across enterprise metadata and data management platforms. - Develop scalable microservices, RESTful APIs and event-driven solutions using Python frameworks such as Flask, FastAPI or Django, ...

... scalable ETL processes using big data technology Leverage large scale cloud infrastructure to build high throughput services Designing and implementing code in SQL/Python Good understanding and implementation experience in Data Governance, Data Quality, Data Modelling etc. Ensure projects are delivered on time and to the satisfaction ...

• Hybrid

... EventBridge, SQS, SNS, API Gateway, DynamoDB, Secrets Manager/Parameter Store, EC2 Instances, AppFlows, StepFunctions, Kinesis), React, Scripting Languages (Python, Shell, Kotlin), Databases (DynamoDB, PostGreSQL), Terraform, Serverless architecture,, Unit Testing Frameworks (JUnit, Mockito) - Experience working on latest ...

• Remote
• Contract

30k

... Erwin Data Modeler, Lucidchart, MySQL Workbench, and Oracle SQL Developer Data Modeler. Possess strong hands-on SQL and Python skills. Strong experience with data architecture principles, including data modelling, ETL/ELT processes, and data management and hands on experience with Big Data technologies. Familiarity with ...

• On-site

... software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and ...

... Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache ...

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

... models and scalable data engineering solutions across cloud and on‑premise ecosystems. The role requires deep expertise in conceptual, logical, and physical data modelling, semantic/ontology-based modelling, and modern data architecture patterns used in Data Warehouses, Data Lakes, Lakehouses, Big Data platforms, and Graph ...

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

... and building data pipelines.- Proficiency in AWS services, particularly S3, Glue, EMR, Lambda, and Redshift.- Strong programming skills in languages such as Python, Java, or Scala.- Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.- Docker, Kubernetes) and orchestration tools ...

Rs 15 - 25 lakhs p.a.

We are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in designing and implementing robust big data solutions that support our data-driven decision-making processes. Job description Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, ...

• Remote

... IST ~ Databricks, Pyspark, Python, SQL, Microsoft Fabric, Azure Data Factory, DataOps practices, and performance optimization We are looking for experienced Data Engineers with strong hands-on expertise in Databricks, PySpark, Python, SQL, and big data processing . The ideal candidate will have proven experience designing ...

Rs 15 - 25 lakhs p.a.

We are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in designing and implementing robust big data solutions that support our data-driven decision-making processes. Job description Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, ...