4,051 big data developer jobs in India.

... components, frameworks, and orchestration patterns. Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark . Design data models for analytical and downstream data products. Implement data-quality checks, validation, reconciliation, and data lineage. Optimize pipelines and BigQuery ...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

... Design and develop batch and real-time data pipelines on GCP.- Build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer.- Ingest data from databases, APIs, files, SaaS applications, and streaming sources.- Design and optimize BigQuery datasets, tables, partitioning, and clustering.- Develop data transformations ...

... of experience working in GCP-based Big Data deployments (both Batch and Real-Time), specifically leveraging BigQuery, Bigtable, Google Cloud Storage, Pub/Sub, Data Fusion, Dataflow, Dataproc, and Airflow. Data Design: Proven history of designing and delivering comprehensive data lake and data warehousing solutions. Data ...

... Overview:We are seeking an experienced Senior Developer to design and optimize data solutions using PL/SQL, SQL, ETL, and Microsoft SSIS, supporting enterprise data warehousing initiatives in a hybrid work model. This role centers on building robust scheduling workflows and integrating multi-channel and supply chain data ...

... consistency, and reliability Building data processing and transformation workflows Monitoring data pipelines and troubleshooting failures Supporting data warehouse and data lake environments Documenting data pipelines, schemas, and processes Collaborating with analysts and developers on data requirements Implementing data validation ...

... PostgreSQL, MySQL, large-scale (multi-TB) database management ETL/ELT Pipelines : Experience with Pentaho, AWS ETL tools Data Architecture : Strong understanding of data warehousing , big data pipelines Tools & Platforms : GitHub, unstructured data handling, Airflow (deep expertise) Big Data (Bonus) : Apache Spark experience Soft ...

... . Good team player . Interest in technologies and innovation . Knowledge of formalisation and communication tools (MS Office - MS SharePoint) . Knowledge of statistical and datamining techniques (SAS, SPSS, VBA, ACCES) or SQL database languages . Proficient in English . Perfectly at ease in a multi-cultural environment

About Data Analytics (DA) Data Analytics is one of the highest growth practices within Evalueserve, providing you rewarding career opportunities. Established in 2014, the global DA team extends beyond 1000+ (and growing) data science professionals across data engineering, business intelligence, digital marketing, advanced ...

About this Position The Data Engineer supports the development and operation of Henkel's enterprise metadata platform, DataHub. The role focuses on building scalable data engineering and governance solutions that connect key enterprise platforms into one centralized ecosystem serving global data consumers. As part of a ...

... statistical modelling, and explainability libraries. Data Platforms & Engineering: Experience working with Snowflake, Snowpark, Spark/PySpark, MLflow, cloud-based data platforms, and scalable analytical environments. Healthcare Data Expertise: Experience working with de-identified patient-level data including claims, specialty ...

Required - 3–7 years of Data/Cloud Engineering experience with hands-on GCP . - Strong SQL and Python skills. - Experience with Spanner, BigQuery and batch/streaming pipelines . - Good understanding of GCP IAM, monitoring, logging and production support. - Strong troubleshooting mindset and ability to ramp up quickly in ...

... monitoring, logging, alerting, incident response, and clean CI/CD via Azure DevOps. - Translate ambiguous business asks into reliable, documented, maintainable data products. 3+ years in data engineering, with significant Spark / PySpark at production scale. - Strong SQL and dimensional data modeling (Kimball-style star schemas, ...

... Data Analyst to support our Business Intelligence team as a visualization developer. You will create compelling dashboards and reports that transform complex data into actionable insights for business stakeholders. Experience: 3+ years in data analysis and business intelligence Advanced Tableau proficiency for dashboard ...

... ML/LLM models, big data technologies such as Apache Spark (Pyspark, Spark SQL). Build end to end data extraction, data transformation and data pipelines to ensure data availability for ML & LLM models that are critical to IN businesses. Enable ML/LLM tools by setting up all the required underlying data infrastructure, data pipelines ...

The EDO Sustainable1 DATA OPERATIONS team at S&P Global is a project-focused, international group dedicated to excellence in sustainability data management. We are responsible for one of the world's most complete datasets on corporate sustainability, supporting global investors, corporates, and stakeholders with in-depth ...

... retail banks, investment banks, broker-dealers & asset management firms, and insurance firms from leading Fortune 500 Companies. Within EY’s Consulting Practice, Data and Analytics team solves big, complex issues and capitalize on opportunities to deliver better working outcomes that help expand and safeguard the businesses, ...

... science, Information Security, or related field. - Relevant certifications such as CISSP, CEH, or OSCP are a plus. Responsibilities - 10–12 years of experience in data loss prevention, data discovery/classification, and database/data security. - Experience with DSPM tools and integration in hybrid environments. - Familiarity ...

... experience preferred. - Implement data transformations and data structures for data warehouse and lake/repository. - Manage cloud and/or on-premises solutions for data transfer and storage. - Process data using spark (PySpark) - Manage cloud and/or on-premises solutions for data transfer and storage. - Collaborate and work with ...

... Behavior, Supply Chain, etc. - Exceptional SQL skills. - Experience with modern visualization tools like Tableau, Power BI, Domo, etc. - Knowledge of open-source, big data, and cloud infrastructure such as AWS, Hive, Snowflake, Presto, etc. - Experience with agile development methodologies. - Experience in retail or e-commerce ...