Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Large Language Models (LLMs) ...
... and efficient data pipelines, data models, and data integration processes Collaborate with crossfunctional teams to understand data requirements and deliver data solutions that meet business needs Ensure data quality and integrity by implementing data validation and cleansing processes Optimize data engineering processes ...
... computer science, Engineering, Information Systems, or similar field, or relevant professional experience in lieu of a degree - 5+ years of hands-on industry data engineering experience - Proficiency in SQL, Spark, Python - Hands-on experience with Databricks, AWS, Snowflake - Demonstrated strength in data modeling, ETL ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Data Engineering Minimum 5 ...
... data using natural language and receive accurate, contextual answers in seconds. This initiative spans multiple business domains and requires a robust, scalable data platform that delivers fresh, validated, and well-documented data at enterprise scale. We are seeking a Data Engineer II to own and scale the data platform powering ...
... Performance Tuning Spark Performance Optimization Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field. - 2–3 years of experience in Data Engineering, NLP Engineering, or AI Data Processing. - Experience working with large-scale datasets and distributed computing frameworks.
... disruptions of the future. We are looking forward to hire Azure Data Lake (ADL) Professionals in the following areas : Role - Azure Data Engineer Azure Data Lake, Data Factory, Pipelines, Synapse (mandatory) SQL, Python, PySpark / Spark-SQL Web tech, relational DBs, data warehousing, ETL design Microsoft Certified Data Engineer ...
... pipeline performance and cost: right-size compute clusters, implement incremental processing, manage storage lifecycle. Qualifications and experience - 5–8 years of data engineering experience, with at least 2 years on Databricks or equivalent Spark-based platforms. - Strong proficiency in Python, SQL, PySpark, and Delta Live ...
Job Role: Senior Data Engineer- Implementation & Modernization Location: Experience: 8+ Years The Data Engineer is responsible for building and optimizing high-performance, large-scaled data solutions on modern cloud platforms. This role focuses on developing Senior Data Engineer- Implementation & Modernization The Data ...
... – Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues. Bachelor’s degree in computer science, Engineering, Information Systems, or related field - 6+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake - Proficiency in PySpark, ...
... services industry! We are hiring a Big Data Engineer to help us build and support our data and analytics delivery pipeline. Design, develop, and optimize scalable data ingestion, transformation, and analytics pipelines for IoT, operational, and business data using Spark and Delta Lake technologies. - Create and tune Spark transformation, ...
Senior Data Engineer - Databricks | PySpark | dbt | Lakehouse Engineering ⚠️ This is NOT a typical Data Engineering position. We are looking for a hands-on Senior Data Engineer with strong, production-grade Databricks experience - someone who has actually built and optimized Lakehouse/Medallion architectures, PySpark & ...
Key Responsibilities : Work in an Agile/SCRUM environment with a seasoned data engineering team. Design, develop, test, and debug large-scale data infrastructure. Build and migrate to a modern Data Lake & ETL infrastructure . Develop data APIs and delivery services for operational and analytical applications. Drive automation ...
Senior Data Engineer – AdTech Experience: 8+ years Hybrid Bangalore (Must have experience in the AdTech or Fintech domain) We're looking for a Senior Data Engineer to design, build, and operate the data pipelines and aggregates that power AdTech platform. This is a hands-on individual contributor role focused on high-scale ...
DATA ENGINEER EXPERIENCE - 5-8 yrs WORK MODE - HYBRID Data Pipeline Development : Design, build, and optimize scalable ETL/ELT pipelines to process and transform data from various sources into Snowflake. Data Modeling : Build and maintain data models within Snowflake for optimized querying and reporting. Cloud Infrastructure ...
Opportunity Overview We are looking for a Data Engineer to build and optimize scalable data pipelines and analytical datasets on our AWS-based lakehouse platform. You will work with Apache Iceberg, AWS Glue, Athena, dbt, and Airflow to support reliable and efficient data processing for analytics and operational use cases. ...
... with broader engineering and product strategy. Design and build scalable, fault-tolerant data pipelines and ETL/ELT frameworks that support batch and real-time data processing at enterprise scale. Architect and evolve the data lakehouse , data warehouse and data integration layer using modern cloud-native technologies (e.g., ...
We are hiring for Senior Data Engineer (MS Fabric & Telecom) Work location: Bangalore, Karnataka, India Experince: 8 to 10 years Notice: Imdiate to 30 days only Role Overview As a Senior Data Engineer, you will be at the forefront of our data transformation, specifically architecting and building the next generation of ...
Pro Arch is seeking a Senior Data Engineer with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, ...