... scientists, product managers, and infrastructure engineers, to translate complex business requirements into scalable technical solutions. By optimizing our Hadoop and Spark ecosystems, you will directly influence the speed and reliability of our data-driven decision-making processes, ensuring that our stakeholders have ...
... Experience with AI cloud platforms - AWS / Azure / GCP.- PySpark and Scala exposure is a plus.- Familiarity with Deep Learning, Big Data environments such as Hadoop/Hive is an advantage.- https://jobeax.com/link/5Im6Nfh21WlEEm2q MSc, MBA or https://jobeax.com/link/s1WvHFV9ITSwCkyS in Statistics, Economics, Mathematics, Finance ...
... architecture reviews. Participate in incident response and operational excellence initiatives for the data warehouse. Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies. Required Skills and Experience - Proficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL. - Extensive ...
... and ensure high availability. Implement security controls, access management, and governance best practices. Required Skills Hands on experience with Cloudera Hadoop/CDP platforms. Strong expertise in HDFS, Spark/PySpark, Python, Hive, YARN, Hue, and CDE. Hands-on experience with Jenkins, GitHub/Bitbucket, and CI/CD practices. ...
... developing, implementing and maintaining Big Data solutions Experience with database modeling and development, data mining and warehousing. Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc) By submitting your application, you consent to being contacted by our Talent Acquisition ...
... knowledge - Fact/Dimension, Normalization, Medallion https://jobeax.com/link/ZwDzpQ6hJ7LcOcF6 to Have : - Finance, Risk, or Compliance data experience.- Spark / Hive / Hadoop experience.- YAML-based pipeline configuration.- CI/CD and Git workflows.- API integrations.- Experience with large-scale production data platforms. ...
... or TensorFlow for building, customizing, and training deep neural networks from scratch. Big Data Ecosystem: Experience with Apache Spark (PySpark) and the Hadoop Ecosystem (HDFS, Hive, MapReduce) for handling, transforming, and querying large-scale distributed datasets. Cloud Architecture: Experience building and deploying ...
Key Responsibilities : - Design, implement, and manage CI/CD pipelines for data and Hadoop applications.- Develop and maintain automated build, deployment, testing, and release processes.- Work extensively with OpenShift and containerized application environments.- Deploy, configure, monitor, and troubleshoot applications ...
... required to fulfill business and technology requirements. - 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. - Strong analytic skills to understand and create solutions for business use cases. - Ensure best practices to implement data governance ...
... certifications. Machine Learning: Knowledge of machine learning concepts and experience with popular ML libraries. Knowledge of big data processing (e.g., Spark, Hadoop, Hive, Kafka) Data Orchestration: Apache Airflow. Knowledge of CI/CD pipelines and DevOps practices in a cloud environment. Experience with ETL tools like Informatica, ...
... KornShell) Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or related fields Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc. If you have a disability and need a workplace accommodation ...
... a dynamic environment - Exceptional data engineering skills in large, high-scale Data platforms and applications using cloud and big data technologies like Hadoop ecosystem and Spark . Your experience includes: - Big data processing frameworks knowledge: Spark, Hadoop, Hive, Kafka, EMR - Big data solutions on cloud (AWS ...
... schema design to create efficient and scalable database structures. - Big Data Technologies: Experience with big data platforms and technologies like Apache Hadoop, Apache Hive, Apache HBase, or Apache Cassandra for handling large volumes of data. - Cloud Platforms: Familiarity with cloud platforms and related services ...
... diverse teams. Work with real-world, large-scale data sets to build and deploy scalable models. Utilize modern distributed systems and data science tools (e.g., Hadoop, Hive/SQL, Apache Spark, TensorFlow, PyTorch, scikit-learn). Ensure reproducibility and quality in analytic pipelines and project deliverables. Visa requires ...
... organization Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Experience with AWS Tools and Technologies (Redshift, S3, EC2) Knowledge of building AI tools, AWS bedrock agents, LLM/foundational models ...
... working with large datasets, distributed computing, and modern data architectures. Key Responsibilities Design, develop, and maintain big data pipelines using Hadoop and Spark Build scalable data processing frameworks using Scala and Spark Develop and optimize Hive queries and SQL scripts for large datasets Work with distributed ...
... desirable. - Familiarity with Agile development practices and DevOps methodologies. Preferred Qualifications: - Experience with Big Data technologies (Spark, Hadoop, Hive) and Machine Learning frameworks is a plus. - Exposure to Healthcare, Financial Services, or other enterprise environments. - Excellent communication, ...
... Experience with SQL Experience with one or more scripting language (e.g., Python, KornShell) Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala) Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Knowledge of computer science fundamentals such as object-oriented ...