We are seeking an experienced Senior Data Engineer to join our IT Services team, where you will play a pivotal role in designing, building, and maintaining robust data infrastructure. This position is critical for ensuring the integrity, efficiency, and scalability of our data ecosystems, enabling advanced analytics and business intelligence initiatives. The ideal candidate will leverage their deep expertise in data architecture and engineering to drive high-quality data solutions that support organizational goals.
Responsibilities
Design and implement scalable data models and comprehensive data architectures to support enterprise needs.
Establish and enforce rigorous data validation protocols to ensure high data quality and accuracy across all systems.
Develop sophisticated error handling mechanisms and logging frameworks to monitor pipeline health and troubleshoot issues efficiently.
Orchestrate complex data workflows and scheduling using tools such as Apache Airflow, Tidal, or Control-M.
Manage version control and automate deployment processes through Git and continuous integration/continuous deployment (CI/CD) pipelines.
Build and optimize Extract, Transform, Load (ETL) processes to facilitate seamless data movement and transformation.
Utilize Databricks, PySpark, and Spark SQL to process large-scale datasets and perform advanced data engineering tasks.
Requirements
Requirements:
Possess 5 to 7 years of professional experience in data engineering roles within the IT Services sector.
Demonstrate strong proficiency in Data Modeling and Data Architecture principles.
Show proven expertise in Data Validation and Data Quality assurance methodologies.
Have hands-on experience with Error Handling and Logging strategies in production environments.
Be skilled in orchestrating workflows using Apache Airflow, Tidal, or Control-M.
Display competency in using Git for version control and managing CI/CD pipelines.
Maintain a solid background in Data Engineering and ETL development.
Possess practical experience with Databricks, PySpark, and Spark SQL technologies.
... Required Experience: 6–10 Years Job Summary We are seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms, scalable data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong hands-on expertise in Microsoft Azure Data Services, large-scale data processing, ...
... Azure Data Fundamentals, Azure Data Engineer, Microsoft Fabric, Snowflake, Databricks, Apache Spark, Airflow or equivalent orchestration tools, dbt, Informatica, data quality, data governance, or cloud data platforms Experience (Career Level Guide) Senior-Level: 5 to 8 years of experience in data engineering, ETL/ELT development, ...
... -Developing data models, defining data standards and guidelines, and establishing processes for data integration, migration, and management. -Lead and mentor a team of data engineers in the design and development of datapipelines, ETL processes, and data integration solution -Create and maintain data dictionaries, which are a comprehensive ...
... exceptional customer https://jobeax.com/link/In098f3J6qDqPAAK Overview :Seeking a Senior Data Engineer to drive the design, deployment, and optimization of our modern data platform for a next-generation CRM product. As a technical and people leader, you will architect robust data pipelines, champion data quality, and collaborate ...
... India. Position Overview: As a Data Engineer, you will be responsible for the Requirement Gathering, Data Analysis, Development and implementation of Orchestrated data pipeline solutions to support our organization's data-driven initiatives to ensure data accuracy and enable data-driven decision-making across the organization. ...
... continuous learning. A place where we move fast, trust you to make an impact, encourage innovation, and support your growth. Job Summary: ProArch is seeking a Senior Data Engineer with 5–8 years of experience to join our Data & Analytics practice. In this role, you will design, develop, and optimize scalable cloud-based data solutions ...
... complex pipeline and infrastructure issues. - Manage the data onboarding lifecycle and integrate internal and external data sources. - Develop and deploy scalable data solutions using Snowflake, dbt, Airflow, and Terraform. - Advocate for modern technologies and best practices that improve data delivery and engineering efficiency. ...
Amgen seeks an experienced Senior Data Engineer in Hyderabad to design and deliver scalable enterprise data solutions. The role involves building batch and real-time pipelines, governed data platforms, and providing technical leadership across analytics and AI initiatives. Responsibilities - Lead design and development ...
Job Title: Data Visualization Engineer (Tableau) Experience: 6–8 years Work Mode: Work from office preferred; remote considered for the right candidate Location: Hyderabad About the Role We're looking for a Senior Data Visualization Engineer to design and build dashboards that people use to make decisions. You'll use Tableau, ...
... an industry that's always evolving and innovating. Join us and be part of a company that values creativity, agility, and impactful work. We’re looking for a Senior Data Engineer to design and maintain scalable data pipelines and infrastructure. You’ll work with Airflow , Databricks , Spark , Python , and SQL , supporting ...