... experience in Python and Spark for data engineering and automation. Strong experience with Azure Data Factory, Azure Databricks, Azure Storage, and related Azure data services. Experience working with Cloudera/Hadoop ecosystem including HDFS, Hive, Spark, and Impala. Experience building and supporting Data Lakes, Data Warehouses, ...
Job Title : Data Support EngineerExperience : 1 - 3 YearsLocation : Bangalore / Chennai / HyderabadWork Mode : HybridRole Overview :We are looking for a proactive Data Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring ...
... continuous improvement of operational processes. Skills and Experience: 3-4 years of progressive experience in data engineering, with expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP). - Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines, ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark, ...
... work Bachelor's degree or higher in Computer Science, Data Engineering, or a related field (or equivalent professional experience) - 3+ years of experience in data engineering, analytics engineering, or a similar data-focused role - Strong SQL skills, including schema design for data warehouse or data lake use cases - Proficiency ...
... experience in data engineering. - Proficiency in: Programming languages - Python, Java, SQL, Spark SQL. - Data technologies - Hadoop, PySpark, NoSQL databases. - Data visualization tools - Qliksense, Tableau, Power BI - Cloud platorms - Azure Data Factory, Azure Databricks, AWS NovintiX is a fast-growing engineering and digital ...
... organization Design data architecture that is simple and maintainable while enabling Data Analysts, Data Scientists, and stakeholders to efficiently work with data. Mentor data team members in architecture and coding techniques. Serve as a source of knowledge for the Data Engineering team for process improvement, automation ...
... backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner… What you will be doing? As a Data Engineer, your role involves crafting and maintaining robust data pipelines, ...
Req ID: 373969 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Data & AI Platform Engineer to join our team in Hyderabad, Karnātaka (IN-KA), ...
... related DevOps automation.- Automate infrastructure and application deployment processes using scripting and DevOps tools.- Collaborate with development, QA, data engineering, and infrastructure teams to improve deployment efficiency.- Implement best practices for source control, continuous integration, continuous delivery, ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Large Language Models (LLMs) ...
A data engineer role in the Specialty Data team should be able to analyze data from multiple source system and design/model Data Marts based on business requirements. Therefore, strong data analytics and technical skills are a must. He or She should be able to create data models, STTMs and other technical documents. The ...
Collaborate with other engineers, customers to brainstorm and develop impactful data products tailored to our clients. Leverage AI and machine learning techniques to integrate intelligent features into our offerings. Develop, and optimize end-to-end data pipelines on AWS Follow best practices in software architecture and ...
... preparing reports, managing files, storing data, and keeping records organized and updated for easy retrieval and understanding. - 3+ years of overall experience in data engineering or related fields. - 2+ years of experience building data pipelines for structured and unstructured data. - 1+ years of experience with big data technologies ...
Company : Very big MNCRole : GCP Data EngineerExperience : 8 - 15 yrsNotice Period : 30 daysLocation : PAN INDIATech Stack :- GCP data engineer- Pyspark- Dataflow- Dataproc- BigQuery- AirflowKey Responsibilities :- Design, develop, and optimize endtoend data pipelines using PySpark, Dataflow, and Dataproc- Implement data ingestion, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... experience in data engineering, building and maintaining large-scale data pipelines and platforms.- 2+ years of hands-on experience with Palantir Foundry, including data ingestion, pipeline builder, transformations and working with Foundry datasets and applications.- Experience building interactive applications using Foundry Workshop, ...
... : - 10+ years of experience in Software or Data Engineering with large-scale, high-traffic, fault-tolerant systems.- Deep experience with semantic modeling, data lakehouse, and data product development.- Expert-level SQL and Python skills.- Experience with modern data platform technologies : Snowflake, ClickHouse, or similar ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...