649 spark jobs in India.

... including Lakehouse, Synapse, Pipelines, and Dataflows with 7+ years experience.- Strong understanding of Delta Lake, Parquet, and OneLake storage.- Knowledge of Spark Notebooks, KQL, and Data Engineering within Fabric.- Experience with source control integration (Git) and CI/CD pipelines.- Familiarity with Azure Data Factory, ...

... data science, or related experience - Proficiency (2–4 years) in SQL, R, Python, Excel, etc., for effective data manipulation - Hands-on experience with Snowflake and Spark/Databricks, adept at Query Profiles and bottleneck identification - Apply creative thinking to solve real-world problems using data-driven insights

... minimal https://jobeax.com/link/d98s5MNtpPjtjH4I Stack & Requirements :- Hands-on experience with Databricks and modern Lakehouse architecture.- Expertise in PySpark, Spark Structured Streaming, SQL, NoSQL databases, Delta Lake.- Proficiency with Unity Catalog for governance and security.- Experience building AI agents, copilots, ...

... Responsibilities:- Design, provision, and manage dedicated Microsoft Azure environments, including Windows Server VMs, WildFly application server, SQL Server, and Spark Gateway.- Build, implement, and maintain CI/CD pipelines using Azure DevOps.- Implement and maintain monitoring, logging, and alerting solutions using Azure ...

... Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, and evaluating ...

... Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, and evaluating ...

... serving layers to support reporting, advanced analytics, ML, and business-critical decisioning use cases. - Design and implement robust ETL/ELT pipelines using PySpark, SQL, Databricks Workflows, Auto Loader, and Delta Live Tables for batch and near real-time processing. - Own architecture standards for data modeling, medallion ...

... services or data intensive environments. - Strong experience building and orchestrating data pipelines with Apache Airflow. • Solid working knowledge of Apache Spark for large-scale data processing. - Strong Python and SQL skills, with a focus on clean, maintainable, production-quality code. Experience designing data models ...

... production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks for ingestion, transformation, and orchestration. Build Spark, SQL, and Python workflows in Databricks. Optimize compute, storage, and pipeline performance for cost efficiency. Data Quality, Governance & Security Build ...

... analytical problem solving and debugging skills Additional Responsibilities: Experience with cloud platforms AWS Azure or GCP Familiarity with big data technologies Spark Hadoop Exposure to workflow schedulers Airflow Prefect Cron Knowledge of CI CD pipelines and version control Git Understanding of data governance and lineage ...

... https://jobeax.com/link/LsX0MHwADPrlj8n9 technical skills in data profiling, analysis, and data management using modern tools and environments (Python, R, SQL, Spark, cloud platforms) Understanding of data lineage concepts and experience with lineage analysis, metadata management, and data cataloging Excellent communication ...

... pipelines integrating sources like ERP systems, IoT devices, iHistorian, web services, and external APIs Leverage modern data engineering stacks (Python, SQL, Spark, Delta Lake, Databricks, Azure) to enable large-scale, high-performance processing Collaborate with stakeholders and IT teams to deliver impactful, business-aligned ...

... performance tuning and query optimization- Good understanding of programming concepts with Python- Strong hands-on experience in implementing data pipelines using PySpark or Spark Scala- Hands-on experience with Databricks, including development, optimization, and management of large-scale data processing and analytics workload- ...

... development. Familiarity with cloud platforms like AWS, Azure, or GCP. Knowledge of data engineering best practices and scalable architectures. Experience with Apache Spark or PySpark. Knowledge of Docker, Kubernetes, and CI/CD pipelines. Experience with data governance and metadata management. Exposure to machine learning data ...

... hands-on experience with AWS services including Lambda, Glue ETL, Athena, S3, DynamoDB, Step Functions, EventBridge, SNS, and SQS. Deep experience in Apache Spark (PySpark/Scala) development, unit testing, and performance optimization. Strong Python programming skills using libraries such as pandas, requests, json, and ...

... reliable software delivery. Key Responsibilities: - Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL - Hands on Databricks Devs – Deployments, CICD, Performance Management - Hands on Databricks Infrastructure like creating resources (Catalogs, Volumes, ...

... architectural guidance across their international footprint. Become an expert in, promote, and recruit contributors for Databricks-inspired open-source projects (Spark, Delta Lake, MLflow, Unity Catalog) across the developer community. 12+ years in data engineering, data science, technical architecture, or a similar pre-sales ...

... machine learning tools such as Scikit-Learn, Pytorch/Tensorflow Experience in Deep Learning applications is a plus Experience with Big Data technologies, e.g.: Spark, Hive, and Presto, and ETL pipelines is a plus Diversity, Equity and Inclusion at Angel One At Angel One, our culture is rooted in Diversity, Equity, and Inclusion. ...

... tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make extensive use of Scala Spark, dbt, and Terraform. Build and expose the data lake/lakehouse so teams can understand business and product performance and make better decisions. Design and ...

... drive both member satisfaction and business growth. Key Responsibilities: - Oversee daily operations, ensuring a seamless experience for all members - Maintain a sparkling clean, secure, and efficient workspace - Become the friendly face of The https://jobeax.com/link/J4ymvmVu0lkw6kdt, fostering a sense of community, and building ...