197 big data jobs in Pune, India.

... looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing ...

... Experience with cloud platforms (AWS / Azure / GCP).- Familiarity with MLOps tooling and practices (e.g., model versioning, CI/CD for ML, monitoring).- Experience with big data technologies (Spark, Databricks, etc.).- Bachelor's / Master's / PhD in Computer Science, Statistics, Mathematics, or a related quantitative https://jobeax.com/link/sEOksQVqU173JbV8 ...

... Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer) - Relevant data engineering or big data certifications Soft Skills ...

... deploying complex data architectures within Microsoft Fabric and the broader Azure ecosystem.- Advanced proficiency in Python and SQL for building sophisticated data processing pipelines and complex analytical models.- Strong background in data engineering principles, including ETL/ELT design, data modeling, and performance ...

Company : Very big MNCRole : GCP Data EngineerExperience : 8 - 15 yrsNotice Period : 30 daysLocation : PAN INDIATech Stack :- GCP data engineer- Pyspark- Dataflow- Dataproc- BigQuery- AirflowKey Responsibilities :- Design, develop, and optimize endtoend data pipelines using PySpark, Dataflow, and Dataproc- Implement data ingestion, ...

• Remote
• Contract

... efficiently: spatial indexing (R-tree / GiST), optimised spatial joins, partitioning, query-plan diagnosis, and geometry simplification - to control runtime and cost.- Big-data and pipeline fluency: Advanced SQL plus distributed processing for large spatial workloads (Spark or Dask), and building reliable, repeatable data pipelines.- ...

... design and code a variety of applications covering transaction processing, analytics, user interfaces, and APIs using a blend of cutting-edge technologies across big data, distributed systems, machine learning, and more. As a Software Engineer, you will deliver these products and solutions with speed and agility as part of ...

• On-site

... software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and ...

... and build scalable data processing systems. The ideal candidate should have hands-on experience working with large datasets, distributed computing, and modern data architectures. Key Responsibilities Design, develop, and maintain big data pipelines using Hadoop and Spark Build scalable data processing frameworks using Scala ...

... AI-first data strategy at scale across 120M+ customer interactions. Databricks Apps & Self-Serve AI Develop and deploy internal AI-powered applications using Databricks Apps — enabling business users to interact with ML models, RAG systems, and analytics agents through governed, self-serve interfaces. Integrate Databricks ...

• Remote
• Contract

30k

... Erwin Data Modeler, Lucidchart, MySQL Workbench, and Oracle SQL Developer Data Modeler. Possess strong hands-on SQL and Python skills. Strong experience with data architecture principles, including data modelling, ETL/ELT processes, and data management and hands on experience with Big Data technologies. Familiarity with ...

... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...

... years of experience • Minimum 3 years of experience in design, build and deployment of Ab Initio-based applications • Expertise in handling complex large-scale Data Lake and Warehouse environments • Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities • Excellent verbal ...

... worldwide. Role Summary: The Data Architect is responsible for the design and evolution of our enterprise data architecture, with a strong focus on reusable data pipelines, data schemas & products, and modern data engineering practices. This role requires an AI-first mindset in data engineering and data modeling activities ...

Rs 15 - 25 lakhs p.a.

We are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in designing and implementing robust big data solutions that support our data-driven decision-making processes. Job description Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, ...

... testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management ...

... affordable healthcare. Build and manage digital analytics datasets and reporting solutions Develop data pipelines and analytical reporting frameworks Support data validation, UAT, process improvements, and analytics initiatives. Experience & Qualification: Python Power BI & Dashboard Development Data Modeling & Data Validation ...

... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...

• Full-time

Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities ...

... build robust data pipelines, data lakes, and marts to support business analysts and data scientists. Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines ...