881 spark jobs in India.

... them. And if you’re like us, we can offer you the ultimate career opportunity that will light a fire within you. Change Management & Evangelist, AI Incubation (SPARK) SPARK | CX International Internal Incubation Team | Location: Pune So, what’s the role all about? NiCE is building SPARK, a new internal incubation team that ...

... https://jobeax.com/link/elpmNuUlUrtRmNOJ : https://jobeax.com/link/deVJxOoPdlgTHrdr : B2C Marketing & https://jobeax.com/link/QMlBTp64c6tcFh8h : AWS | Apache Spark | PySpark / https://jobeax.com/link/rvQtoDz2MEe5S7Tx are looking for an experienced Senior Big Data Engineer to design, develop, and optimize scalable big data ...

... experience in data engineering or data development.- Mandatory hands-on experience with the Palantir Foundry platform.- Strong programming skills in Python and PySpark.- Proficiency in SQL, preferably Spark SQL, including query development and optimization.- Experience building and maintaining scalable data pipelines and data ...

... methodology JavaScript Jenkins Kimball Linux - Redhat Negotiation Netezza NewSQL Oracle Exadata Performance Tuning Perl Platform Update Management Project Management PySpark Python R RDD Optimization SantOs SaS Scala Spark Shell Script Snowflake SPARK SPARK Code Optimization SQL Stakeholder Management Sun Solaris Synapse Talend Teradata ...

... Work with Azure Data Lake Storage (ADLS Gen2) for storing and processing large datasets. - Implement Delta Lake and Lakehouse architecture concepts. - Optimize Spark jobs for performance and scalability. - Develop data transformations using SQL and PySpark. - Collaborate with data architects, analysts, and business stakeholders. ...

... event streaming solutions , ensuring reliable data ingestion, processing, and integration. - Develop production-grade data processing applications using Apache Spark and Scala/PySpark . - Optimize Spark workloads through effective partitioning, caching, skew handling, join optimization, and performance tuning. - Write advanced ...

... event streaming solutions , ensuring reliable data ingestion, processing, and integration. - Develop production-grade data processing applications using Apache Spark and Scala/PySpark . - Optimize Spark workloads through effective partitioning, caching, skew handling, join optimization, and performance tuning. - Write advanced ...

... event streaming solutions , ensuring reliable data ingestion, processing, and integration. - Develop production-grade data processing applications using Apache Spark and Scala/PySpark . - Optimize Spark workloads through effective partitioning, caching, skew handling, join optimization, and performance tuning. - Write advanced ...

... (Bronze, Silver, Gold).- Define data ingestion, transformation, integration, and orchestration strategies.- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.- Implement data governance, security, access control, ...

... real-time data ingestion and processing pipelines.- Build and optimize ELT/ETL frameworks leveraging Synapse Pipelines, Dedicated SQL Pools, Serverless SQL Pools, Spark Pools, PySpark, and SQL-based transformations.- Drive the implementation of modern data platform architectures, including Data Lakehouse, Medallion Architecture, ...

... Workflows for training, retraining, evaluation, and inference, with task dependencies, retries, and alerts. - Support classification and forecasting as Python and Spark jobs on Databricks. - Tune cluster size, autoscaling, Spark settings, and Delta Lake reads and writes so jobs stay reliable and cost-efficient. - Convert Data ...

... high-quality data https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities :- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.- Build and optimize ETL/ELT workflows for processing structured and semi-structured data.- Develop data transformation logic using Python, PySpark, and SQL.- ...

... governance security and compliance best practices within Databricks Power BI and API environments. Technical Skills: - Proficiency in Databricks including Delta Lake Spark SQL. - Strong programming skills in Python Scala or Java. - Experience with Apache Spark for big data processing. - Knowledge of SQL for querying and transforming ...

... https://jobeax.com/link/V9v5V1Tltw2JcjY6 Responsibilities :- Design, build and maintain ETL/ELT pipelines using Azure Synapse Analytics (dedicated and serverless SQL pools, Synapse Pipelines, Spark pools).- Develop data models and warehouse structures to support BI and reporting.- Integrate data from multiple sources (ERP, CRM, e-commerce, flat files, APIs) ...

... Airflow, Datawarehousing, Data https://jobeax.com/link/jJwPeXOR5xzgNWwu skills :- Strong hands-on experience in Python Development.- Extensive experience with PySpark / Apache Spark.- Expertise in Data Engineering, SQL Unix + Big Data (Hadoop + Hive), Airflow, Datawarehousing, Data modelling and data processing frameworks.- ...

... Airflow, Datawarehousing, Data https://jobeax.com/link/jJwPeXOR5xzgNWwu skills :- Strong hands-on experience in Python Development.- Extensive experience with PySpark / Apache Spark.- Expertise in Data Engineering, SQL Unix + Big Data (Hadoop + Hive), Airflow, Datawarehousing, Data modelling and data processing frameworks.- ...

... https://jobeax.com/link/QJthsbNyq6dgbViB Responsibilities :- Build and maintain scalable batch and real-time data pipelines for fraud analytics.- Develop and optimise Spark-based data processing frameworks.- Design Kafka-based streaming and event-driven architectures.- Implement efficient data ingestion frameworks and integrate ...

... https://jobeax.com/link/tHimJJWnl73Dwmn0 Stack & Requirements:- Strong hands-on development experience with Python, FastAPI, and async programming.- Expertise in Big Data architectures: Apache Spark/PySpark, Kafka, Amazon S3, Athena.- Hands-on AWS experience: Lambda, S3, Athena, KMS, Secrets Manager, IAM, CloudWatch.- Strong understanding of Gen AI and Agentic ...

... GitOps deployment models. • Proficiency in at least one programming or scripting language. • Exposure to data technologies such as Elasticsearch, Cassandra, or Spark (desirable). • Familiarity with software development methodologies (desirable). • Ability to communicate technical progress and risk clearly to non-technical ...

... performance tuning. - Snowflake data modeling. - Apache Airflow experience developing and testing pipelines in Airflow and Python. - Apache Kafka experience. - Apache Spark experience, including hands-on PySpark. - Experience with Iceberg and Parquet data formats. - AWS experience, particularly S3 data lakes, partitioning, and lifecycle ...