894 spark jobs in India.

... including Lakehouse architecture, data pipelines, notebooks, semantic models, and Power BI integration.- Strong hands-on experience with Azure Databricks including Spark, PySpark, Delta Lake, and performance optimisation.- Experience designing Bronze, Silver, and Gold data architectures.- Experience with ingestion and orchestration ...

... Architecture (Bronze, Silver, Gold) using Delta Lake for ACID compliance, versioning, schema evolution, and data quality. - Provide hands-on leadership in Databricks Spark (PySpark, Scala, SQL), Delta Live Tables, Structured Streaming, and Unity Catalog for advanced governance, security, and multi-workspace management. - Integrate ...

... practices in the big data ecosystem. Requirements - Strong proficiency in Java and/or Scala for big data application development. - Extensive experience with Apache Spark for large-scale data processing. - Hands-on experience with Google Cloud Platform services, including Airflow, Dataproc, and BigQuery. - Understanding of data ...

... Gartner Magic Quadrant 2025 for VoC Platforms, positioned as a Leader in the 2025-2026 IDC MarketScape for Worldwide VoC Applications, and recognized by QKS Group (SPARK Matrix).We are seeking a visionary and execution-driven Chief Technology Officer (CTO) to lead the company's technology strategy, architecture, engineering excellence, ...

... experience with a PhD, OR 8+ years of relevant work experience. - Experience in solving data problems using data technologies - Experience with Hadoop, Hive, HBase, Spark, Trino, or comparable distributed data systems. - Experience in designing and implementing data pipelines and large-scale data processing jobs. - Experience ...

... with BI tools such as Looker or Grafana. - A passion for applied AI/ML and eagerness to bring research ideas into production. - Big Data: Strong expertise with Spark, Hadoop, Kafka, and data warehousing (Snowflake, SparkSQL). - ML Ops/Infrastructure: Experience with CI/CD, Docker, Kubernetes, Airflow/MLflow, and experiment ...

... preferred.- Strong in algorithm design, database programming (RDBMS), and text analytics.- Knowledge of NoSQL and Big Data technologies like MongoDB, Apache Spark, Hadoop stack, and Python data science stack is a plus.- High problem-solving skills: able to logically breakdown problems into incremental milestones, prioritize ...

... preferred.- Strong in algorithm design, database programming (RDBMS), and text analytics.- Knowledge of NoSQL and Big Data technologies like MongoDB, Apache Spark, Hadoop stack, and Python data science stack is a plus.- High problem-solving skills: able to logically breakdown problems into incremental milestones, prioritize ...

... with clean, testable coding practices.- Data Pipelines: Hands-on experience building batch and streaming ETL/ELT pipelines using tools such as Apache Airflow, Spark, Kafka, or dbt.- Databases & Storage: Solid knowledge of PostgreSQL or similar relational databases, plus at least one NoSQL, columnar, or time-series store; ...

... https://jobeax.com/link/ZitjVqvb84V4AOyQ to Have:- Experience with Oracle databases.- Exposure to Informatica BDM / IICS.- Familiarity with Hadoop / Cloudera ecosystem.- Exposure to Spark / PySpark.- Experience working in Banking / Financial Services or other large enterprise environments.- Knowledge of Unix / Linux scripting.- Exposure to scheduling ...

... and assist seniors during internal and statutory audits. Perks & Benefits At EnviPack, we believe that our people are the foundation of our success — and the spark that fuels our mission. That’s why we’ve designed a benefits package that empowers you to thrive, both personally and professionally: - Competitive Salary : ...

... Strong hands-on experience with Databricks. Strong understanding of Delta Lake and Lakehouse architecture. Excellent knowledge of SQL. Hands-on experience with PySpark / Apache Spark. Strong understanding of Star Schema, Snowflake Schema, Fact and Dimension modelling. Experience with Slowly Changing Dimensions (SCD). Strong ...

... management, with a proven ability to design efficient data models that support diverse analytical requirements.- Hands-on experience with Big Data frameworks including Spark and Hadoop, coupled with a strong understanding of distributed computing principles.- Proven track record of deploying and managing data solutions within AWS ...

... work environment • Best-in-industry renumeration package Essential Technical Skills: • Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools: Tableau and PowerBI • Experience with cloud, container and micro service infrastructures ...

... supervised and unsupervised learning methods, time-series analysis, and outlier detection algorithms. - Understanding big data technologies and tools like Hadoop, Spark, or cloud platforms (AWS, Google Cloud, etc.) is a plus. - Problem Solving - Strong analytical thinking, problem-solving skills, and the ability to work with ...

... Here’s what will give you an edge… Proficiency. You are proficient in Python programming, Manage ML Libraries and TensorFlow, PyTorch, XgBoost, Scikit-learn, Spark ML and code/model versioning in Git, MLFlow. Platforms. You have worked on Cloud computing platforms like Azure,databricks and know well to work on data analytics ...

... scalability. - Design, build, and optimize scalable cloud-native data pipelines and automation solutions using SQL(Snowflake), BigQuery, Python, Databricks, PySpark, Spark, and ETL/ELT frameworks. - Leverage AI/GenAI/LLMs (including Claude Code), AI integrations, MCPs, APIs, and web scraping technologies to automate data ...

... ensuring security, quality, and interoperability. Knowledge, experience & capabilities - Databricks Ecosystem: Expert-level knowledge of Databricks Lakehouse, Spark SQL, Delta Lake, Unity Catalog etc. - Programming: Proficiency in Python, PySpark, or Scala for ETL/ELT development. - Cloud Platforms: Hands-on experience with ...

... Factory, and Azure Functions.- 5+ years of hands-on experience with Azure and Big Data technologies, including Fabric, Databricks, Python, SQL, ADLS/Blob Storage, PySpark, and Spark SQL.- 3+ years of experience working with RDBMS technologies.- Proficiency with developer tools such as Azure DevOps, Git, and Visual Studio Team ...

... development.- Strong in algorithm design, database programming (RDBMS), and text analytics.- Knowledge of NoSQL and Big Data technologies like MongoDB, Apache Spark, Hadoop stack, and Python data science stack is a plus.- High problem-solving skills : able to logically break down problems into incremental milestones, prioritize ...