2,467 big data python jobs in India.

... working with large datasets, building data pipelines, and writing efficient, scalable Python code. Key Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, ...

... distributed data processing. - Practical exposure to Machine Learning and Deep Learning model development and deployment. - Experience working with large, complex datasets in cloud-based or big data environments. - Practical understanding of Nixtla library is a plus. - Experience with MLOps , model monitoring, and CI/CD pipelines. ...

• On-site

... Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong ...

... deploying complex data architectures within Microsoft Fabric and the broader Azure ecosystem.- Advanced proficiency in Python and SQL for building sophisticated data processing pipelines and complex analytical models.- Strong background in data engineering principles, including ETL/ELT design, data modeling, and performance ...

... similar stack a must - Experience with functional and object-oriented programming, Python or Scala a must - Ability to collaborate with a diverse set of engineers, data scientists and product managers - Experience in agile methodology Development and support experience in Big Data domain Architecting, developing, implementing ...

... Azure . Ensure data quality, governance, reliability, monitoring, and compliance. Partner with Data Scientists, Fraud Analysts, and Engineering teams to deliver data-driven solutions. 4+ years of experience in Data Engineering or Big Data Engineering. - 2+ years of experience building large-scale distributed data processing ...

... production-ready code and perform data analysis with Python and SQL Create workflows for model development and apply feature engineering methods Use Azure AI Search to make data and models easier to consume for business needs Coordinate with developers and project managers using GitLab and Jira Refine data pipelines and tune model performance ...

• Full-time

... where required. Work with Linux/Unix environments and efficiently process large datasets. WHAT MAKES YOU A GREAT FIT - 3+ years of professional experience in Data Engineering, Big Data, Analytics Engineering, or a related field. - Strong hands-on programming experience with Python for data processing, automation, and pipeline ...

Job Overview : We are seeking an experienced Python Developer to join our team. The ideal candidate will have a strong background in backend development, cloud technologies, and big data processing. This role involves leading technical projects, mentoring junior developers, and ensuring the delivery of high-quality https://jobeax.com/link/JpsOC0VrTgitAlOy ...

... Experience with cloud platforms (AWS / Azure / GCP).- Familiarity with MLOps tooling and practices (e.g., model versioning, CI/CD for ML, monitoring).- Experience with big data technologies (Spark, Databricks, etc.).- Bachelor's / Master's / PhD in Computer Science, Statistics, Mathematics, or a related quantitative https://jobeax.com/link/sEOksQVqU173JbV8 ...

... members. We are seeking experienced Data Engineering professionals with 4–6 years of hands-on expertise in Big Data technologies, with a focus on building scalable data solutions using Google Cloud Platform (GCP). Key Skills & Experience: Strong programming skills in Python and Bash Solid understanding of SQL and data warehousing ...

... Experience with cloud platforms AWS Azure or GCP Familiarity with big data technologies Spark Hadoop Exposure to workflow schedulers Airflow Prefect Cron Knowledge of CI CD pipelines and version control Git Understanding of data governance and lineage tools Preferred Skills: Technology- Open System- Open System- ALL- Python

• Full-time

... storage, and data processing concepts. Familiarity with cloud-native data storage solutions such as S3, Blob Storage, BigQuery, or Redshift. Experience with data orchestration tools like Apache Airflow or similar. Knowledge of data formats like Parquet, Avro, or JSON. Strong coding skills in Python for building data pipelines. ...

... Experience with containerization technologies (e.g., Docker, Kubernetes) - Experience with CI/CD pipelines and DevOps methodologies. - ETL or ELT: Azure Data Factory, Databricks, Synapse, dbt (any two – Mandatory). Data Warehousing: Azure SQL Server/Redshift/Big Query/Databricks/Snowflake (Anyone - Mandatory). Data Visualization: ...

... team's capability to foster our "you build it, you run it" https://jobeax.com/link/ez4itv0T39YjSAnc Responsibilities : - Design and implement data processing in a big data environment.- Database design and management in a cloud environment.- Build and sustain the pipeline of data ingress, processing, and data distribution.- ...

• Remote

10k - 33k

... or Azure environments Python & scripting for automation and data processing Data streaming technologies (Kafka, Spark, Flink) Big Data platforms (Snowflake, Databricks, Hadoop, Teradata) Exposure to AI/ML and advanced analytics Experience with NoSQL databases Ability to design scalable and maintainable data architectures. ...

... the ability to thrive in a fast-paced environment. - Clear communication and technical collaboration skills. Preferred Skills (Nice to Have) Familiarity with big data processing tools like Spark or PySpark. Basic understanding of data warehousing concepts and dimensional data modeling. Exposure to version control systems ...

... Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python / Java / Data Governance Drive ...

... Learning and GenAI algorithms.- Experience with AI cloud platforms - AWS / Azure / GCP.- PySpark and Scala exposure is a plus.- Familiarity with Deep Learning, Big Data environments such as Hadoop/Hive is an advantage.- https://jobeax.com/link/5Im6Nfh21WlEEm2q MSc, MBA or https://jobeax.com/link/s1WvHFV9ITSwCkyS in Statistics, ...

... Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer) - Relevant data engineering or big data certifications Soft Skills ...