888 spark jobs in India.

... - Experience with Data Reporting Tools: QlikSense, QlikView, Spotfire, Tableau, JReview, Business Objects, Cognos, MicroStrategy, IBM DataStage, Informatica, Spark or related - Familiarity with other languages and concepts: .NET, C#, Python, R, Java, HTML, SSRS, AWS, Azure, Spark, REST APIs, Big Data, ETL, Data Pipelines, ...

... large-scale distributed data platforms and data lakes.- Manage data ingestion from diverse sources and file formats.- Perform Big Data orchestration using Airflow, Spark on Kubernetes, Yarn, and Oozie.- Optimize SQL-Hive and Spark queries for performance.- Ensure data validation and quality.- Support 24x7 operations as per the ...

... - Strong experience in enterprise data engineering and data architecture. - Hands-on expertise with Azure Databricks, Azure Data Factory/Synapse, ADLS, SQL, Spark/PySpark, and Delta Lake. - Strong understanding of data modeling, ETL/ELT architecture, data governance, security, and access-control concepts. - Experience ...

... execution budget per request.- Engineer Real-Time Feature Streaming : Design, optimize, and maintain distributed, event-driven data pipelines (using Flink, Kafka, Spark) to extract and aggregate alternative data features on the fly.- You will turn chaotic user activity streams into clean, structured inputs for our models in ...

... Expertise in containerization and orchestration technologies including Docker and Kubernetes Hands-on experience with data processing frameworks such as Apache Spark and Databricks Proficiency in programming languages including Python with an understanding of data manipulation and ML libraries like Pandas, TensorFlow, and ...

... CloudFormation, or Ansible Expertise in containerization and orchestration tools such as Docker and Kubernetes Skills in using data processing frameworks like Apache Spark or Databricks Proficiency in Python, with familiarity with data manipulation and ML libraries such as Pandas, TensorFlow, or PyTorch Familiarity with CI/CD tools ...

... Assortment Optimization, or Supply Chain https://jobeax.com/link/amUwDUl4LnheSACI & Data EngineeringStrong programming expertise in Python, SQL, R, NoSQL, and Spark / PySpark. Experience with cloud platforms : AWS, Azure, https://jobeax.com/link/O5j0VaJ4ghknsBis Libraries & FrameworksHands-on experience with NumPy, Pandas, ...

... technical leadership, mentoring, troubleshooting, and communication https://jobeax.com/link/Cexs453KRiH2S1rJ Skills : - Databricks certification.- Experience with PySpark, Spark, R, Posit Workbench, or Posit Connect.- Knowledge of Generative AI, LLM-based applications, model monitoring, and observability.- Experience in insurance, ...

... one of India's largest financial institutions. The platform spans Cloudera on AWS, an on-premises Oracle data warehouse, Oracle GoldenGate replication, Apache Spark and Alation for data governance. Role summary Protect the enterprise data platform by managing access, encryption, auditing and security controls across cloud ...

... skills and the ability to work independently as well as with cross-functional https://jobeax.com/link/826m1CLX72UbjX1R to Have :- Experience with Databricks / Spark.- Knowledge of Kafka or Azure Event Hubs.- Experience with data migration projects.- Knowledge of NoSQL databases and distributed systems.- Experience working ...

... significant technical leadership exposure.- Strong hands-on experience with Microsoft Azure and Azure Databricks.- Expertise in Data Engineering, ETL/ELT, SQL, Spark/PySpark, and Data Modelling.- Excellent Python programming skills and experience building REST APIs, microservices, and backend applications.- Understanding ...

... management, with a proven ability to design efficient data models that support diverse analytical requirements.- Hands-on experience with Big Data frameworks including Spark and Hadoop, coupled with a strong understanding of distributed computing principles.- Proven track record of deploying and managing data solutions within AWS ...

... client relationships and ensure stakeholder expectations are effectively managed. Required Skills Strong programming experience in Python, R, SQL, NoSQL, and Spark. Hands-on experience with Python libraries such as NumPy, Pandas, Scikit-learn, TensorFlow, and NLP libraries. Strong understanding of statistics, hypothesis ...

... Familiarity with DAX Studio and Tabular Editor . - Experience in handling high-volume data in production environme - Exposure to Big Data technologies such as: - - PySpark (must have) - Hadoop - Hive / HDFS - Spark Streaming (optional but preferred) Why Join Us? - Work with a team that's passionate about data innovation. - Exposure ...

... concurrency, asynchronous processing, and memory optimisation.- Proven track record designing high-throughput distributed systems, event-driven architectures (Kafka, Spark), and distributed caching.- Deep understanding of database internals, query optimisation, and schema design across both relational (PostgreSQL, MySQL) and analytical/columnar ...

... one of India's largest financial institutions. The platform spans Cloudera on AWS, an on-premises Oracle data warehouse, Oracle GoldenGate replication, Apache Spark and Alation for data governance. Role summary Protect the enterprise data platform by managing access, encryption, auditing and security controls across cloud ...

... platforms (AWS, Microsoft Azure, or Google Cloud Platform) for data warehousing, storage, and data processing.- Experience with big data technologies such as Spark, Hadoop, or Delta Lake.- Knowledge of data governance, data quality, master data management, and security best practices.- Familiarity with BI and reporting ...

... skills and the ability to work independently as well as with cross-functional https://jobeax.com/link/826m1CLX72UbjX1R to Have :- Experience with Databricks / Spark.- Knowledge of Kafka or Azure Event Hubs.- Experience with data migration projects.- Knowledge of NoSQL databases and distributed systems.- Experience working ...

... https://jobeax.com/link/8wlyHtoLaoPBncXt Skills:- Experience with ETL/Data Engineering tools or frameworks.- Exposure to cloud platforms such as AWS, Azure, or GCP.- Knowledge of tools such as Airflow, Spark, Databricks, or similar technologies.- Experience with monitoring and ticketing tools.- Understanding of CI/CD and DevOps practices. (ref:hirist.tech)

... https://jobeax.com/link/ZitjVqvb84V4AOyQ to Have:- Experience with Oracle databases.- Exposure to Informatica BDM / IICS.- Familiarity with Hadoop / Cloudera ecosystem.- Exposure to Spark / PySpark.- Experience working in Banking / Financial Services or other large enterprise environments.- Knowledge of Unix / Linux scripting.- Exposure to scheduling ...