894 spark jobs in India.

... Experience with cloud service providers like AWS, Digital Ocean- Familiarity with open source unified stream-processing and batch-processing frameworks like Apache spark/ Apache Flink would be a plus- Experience with Agile software development and knowledge of best practices for agile Scrum team- Proficient with GIT version control- ...

... | DAX | SQL | Power Query | Data Modeling | ETL/ELT | Azure Data Factory | Microsoft Fabric | Data Warehousing | Lakehouse | SQL Server/Azure SQL | Python | Spark/PySpark | Delta Lake | Git | Power BI Service Duties - Develop and maintain advanced Power BI dashboards and reports using DAX, Power Query, data modeling, RLS, ...

... solution design workshops, estimations, and architecture reviews. Required Skills Core Technical Skills - Databricks (Expert Level or Databricks Champion) - Apache Spark (PySpark / Spark SQL) - Delta Lake - Kafka Streaming - Semi-structured data processing like json, xmls - AWS Cloud Services - ETL/ELT Design and Development ...

... writing. - Demonstrated ability to collaborate effectively across time zones. Preferred: - Experience with Big Data processing frameworks, specifically Apache Spark (PySpark or Scala-Spark). - Hands-on experience with modern data platforms like Databricks and orchestration tools like Apache Airflow. - Experience building, ...

... Takes ownership of assigned deliverables and contributes to team success. Preferred Technical Skills - Databricks (Workflows, Delta Lake, Unity Catalog) - Apache Spark / PySpark - Harness CI/CD Pipelines - Python - SQL - Azure Data Platform, GCP, or AWS - Git/GitHub - Terraform - Monitoring and Observability Tools - DevOps ...

... experience developing scalable backend services using Java, REST APIs, JDBC, and relational databases. - Strong experience building distributed data pipelines using Spark, Kafka, Hadoop, Snowflake, SQL, and AWS. - Experience designing and optimizing large-scale analytical data platforms for Mobile AdTech using Java, Spark, Kafka, ...

... practices with governance and access controls Requirements - 2-3 years professional experience with data tools in marketing or similar domain - Databricks SQL, Spark workflows, and Delta Lake expertise - Advanced SQL for complex transformations and performance optimization - Python proficiency for data processing, automation, ...

... SQL queries, with a demonstrated ability to optimize query performance for large datasets.- Hands-on experience with Big Data technologies, specifically Apache Spark and the Hadoop ecosystem.- Expertise in Spark performance tuning and optimization techniques to ensure efficient data processing.- 4-6 years of practical experience ...

... data pipelines and architectures using GCP services including BigQuery, Cloud Storage, Dataproc, Dataflow, Cloud Composer, and Cloud Functions. - Proficiency in Spark, PySpark, and Scala for big data processing. - Experience with software version control and CI/CD tools such as Git, Jenkins, and Cloud Build. - Relevant GCP ...

Job Description : - PySpark and Advanced SQL is a must.- We are looking for a Data Engineer with excellent SQL skills and advanced Python and PySpark along with other required skillsets.- 5 - 7 years of experience as a Data Engineer with extensive working experience using PySpark, Advanced SQL, Snowflake, complex understanding ...

... data manipulation and automation.- SQL - advanced querying and optimization https://jobeax.com/link/tMGHc3bW7JBnCajo Qualifications : - Experience with big data technologies (e.g., Spark, Hadoop).- Familiarity with CI/CD pipelines and DevOps practices.- Knowledge of data warehousing concepts and tools (ref:hirist.tech) []

... datasets.- Develop data solutions using Python, SQL and Scala; Java knowledge is an added advantage.- Work with data processing and ML technologies including Spark and Databricks.- Support machine learning use cases using frameworks such as TensorFlow, scikit-learn and PyTorch.- Leverage AWS services for data storage, compute, ...

... portability awareness (AWS, GCP, on-prem)spanning compute, networking, storage, and identity.- Operate and tune the platforms big-data and streaming infrastructure : Spark / PySpark and Ray clusters (BDB Jobs), Kafka / MQTT streaming (BDB Data Pipeline), and lakehouse storage on open table formats (Apache Hudi / Iceberg).- Build ...

... enterprise lakehouse platforms, Power BI, AI/ML pipelines, and business applications. - Integrate structured, semi-structured, and unstructured data using Python, Spark/PySpark, SQL, and data orchestration pipelines. - Implement entity resolution, relationship extraction, semantic enrichment, and knowledge graph construction. ...

... enterprises - Demonstrated hands-on design and implementation depth across Azure/Databricks Lakehouse platforms - Expert proficiency in Azure, ADLS, Databricks (Spark, Delta Lake, Unity Catalog, Workflows/DLT), and Power BI - Proven track record defining enterprise architecture standards and operationalizing design authority ...

... Cloudflare, Dragonfly or Redis-compatible caching, Elasticsearch, OpenTelemetry/APM and Kibana; payment gateways, supplier integrations, data warehousing and Spark. Familiarity with comparable technologies is welcome. (ref:hirist.tech) [{"name": "flexible_hours", "text": "Flexible hours", "categoryName": "Working schedule"}]

This is a remote position. SPARK+ is looking for a creative and motivated Graphic Design Intern to join our remote team and support the design needs of our digital products, platforms, social media, and brand initiatives. The intern will work closely with the marketing, product, and creative teams to create engaging visual ...

... leaders. - Strong technical background in large-scale distributed data and analytics systems. - Hands-on architectural understanding of technologies such as Kafka, Spark/Spark Streaming, Snowflake, HDFS, and object storage. - Deep understanding of streaming, batch processing, distributed computing, data modeling, and analytical ...

... contribute to the operational excellence of critical finance data platforms. The successful candidate will work across multiple technologies, including Databricks, Spark, ETL tools, Airflow, and Azure cloud services, ensuring platform stability, incident resolution, and operational efficiency. This position is ideal for technology ...

... Data Warehousing experience. - Strong expertise in: - Azure Data Factory (ADF) - Azure Databricks - Azure Synapse Analytics - Azure Data Lake Storage (ADLS) - PySpark / Spark - Python - Informatica PowerCenter - SQL Server / Oracle - ETL / ELT Development - Strong understanding of: - Data Modeling - Data Warehousing - Data ...