... Big Data Engineer – Scala We are looking for an experienced Big Data Engineer with strong expertise in Scala and Apache Spark to design, develop, and optimize scalable data-processing solutions. The ideal candidate should have hands-on experience with distributed data platforms, large-scale ETL/data pipelines, and big data ...
... scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists What you need - Spark - AWS - Data warehousing ...
... software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions. 2. Design, develop, and maintain scalable Big Data applications and distributed data processing solutions. 3. Integrate new data sources, tools, and technologies into existing Big Data ecosystems. ...
We are looking for an experienced Big Data Engineer with strong software engineering and distributed data processing skills. The ideal candidate should have hands-on experience with Java, Apache Spark, Python/Scala, and the Hadoop ecosystem to build scalable, reliable data solutions. Roles & Responsibilities Analyze complex ...
... Apache Airflow. The ideal candidate will have hands-on experience developing scalable data engineering solutions, API-driven backend services, and distributed Big Data applications. Key Responsibilities Design, develop, test, and deploy scalable Big Data applications and data engineering solutions on AWS. Develop API-driven ...
... platforms for batch and real-time data processing - Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets - Solve complex business problems by leveraging data engineering best practices and advanced technologies What you need - SQL - ETL - Python - Spark - Azure ...
... Develop scalable data solutions to collect, ingest, transform, and store large volumes of structured and unstructured data - Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, scalability, and performance What you need - SQL - ETL - Python - Spark - Databricks - Azure Data Factory ...
Mid-level data science role at Citi in Pune. Needs 4+ years. What you'll do - Responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team What you need - Spark - SQL - Python - Hadoop - ETL - Linux Good to have - FastAPI ...
... Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Role • Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or ...
... up-and-coming data management and software engineering technologies into existing data structures.- Develop set processes for data integration, data mining, data modeling, and data production.- Research new uses for existing data.- Collaborate with members of your team (e.g., Business Analysts, the IT team, data scientists) ...