3,461 director data engineering jobs in India.

... – Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues. Bachelor’s degree in computer science, Engineering, Information Systems, or related field - 6+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake - Proficiency in PySpark, ...

... Expertise in developing data transformation pipelines using DBT . Experience building and maintaining workflows using Apache Airflow . Proficiency in Python for data engineering and automation. Experience designing, developing, and supporting end-to-end data pipelines . Strong understanding of data modelling, data quality, ...

... self-service analytics. - Collaborate with Product, Engineering, Operations, and business stakeholders to define, implement, and maintain meaningful KPIs, metrics, and data products that support decision-making. - Build and execute large-scale data migration solutions for transferring historical and operational data from source systems ...

Senior Data Engineer - Databricks | PySpark | dbt | Lakehouse Engineering ⚠️ This is NOT a typical Data Engineering position. We are looking for a hands-on Senior Data Engineer with strong, production-grade Databricks experience - someone who has actually built and optimized Lakehouse/Medallion architectures, PySpark & ...

... degree in an analytical field (e. g. Computer Science, Engineering, Mathematics, Statistics, Operations Research, Management Science). 3+ years of experience with data analysis and metrics development. - 3+ years of experience analyzing and interpreting data, drawing conclusions, defining recommended actions, and reporting results ...

Key Responsibilities : Work in an Agile/SCRUM environment with a seasoned data engineering team. Design, develop, test, and debug large-scale data infrastructure. Build and migrate to a modern Data Lake & ETL infrastructure . Develop data APIs and delivery services for operational and analytical applications. Drive automation ...

... . Good team player . Interest in technologies and innovation . Knowledge of formalisation and communication tools (MS Office - MS SharePoint) . Knowledge of statistical and datamining techniques (SAS, SPSS, VBA, ACCES) or SQL database languages . Proficient in English . Perfectly at ease in a multi-cultural environment

... ETL/ELT patterns for efficient data ingestion and processing Apply advanced SQL for data querying, transformation, and analysis Collaborate with analytics and engineering teams to support data-driven decision making Ensure data quality, reliability, and performance across data pipelines Apply analytics engineering best practices ...

... including event-driven designs. - Proficiency in one or more languages used for data engineering (Python, Java, Scala, or Go). - Experience with distributed data processing (Spark, Flink, or equivalent) and performance tuning at scale. - Experience with AWS data services and cloud-native patterns (S3, Glue/EMR, Athena, ...

... requirements. Strong communication skills to collaborate with technical and non-technical teams. Experience with containerization (Docker, Kubernetes). Knowledge of machine learning models and integration into data pipelines. Agile or Scrum methodology experience. Familiarity with CI/CD processes for data engineering workflows.

... policies and procedures. Ensure to get updated with ISMS roles as assigned by the department/process heads. Required Qualifications - 4–5 years of experience in data engineering - Strong hands-on experience with Python, SQL, PySpark/Spark - Experience with AWS S3, Glue, Athena - Experience with DBT and Airflow (or equivalent) ...

... intelligent conversational interfaces. Role Overview: Position: Generative AI Chatbot & Azure Open AI with LLM and RAG Experience Required: 5+ years in GEN AI (Data Science) Location: Gurgaon /Bangalore /Hyderabad /Pune Employment Type: Permanent Notice Period: Preferred Immediate joiners Key Responsibilities: Design and ...

... with demonstrated expertise in enterprise data management and related technologies - 5-10 years of data architecture experience - Thorough knowledge of Erwin Data Modeler - Thorough knowledge of data warehousing concepts and the ability to create a dimensional design - Strong understanding of data modeling best practices ...

... accountable for delivering exceptional results. Perform development work and technical support related to our data transformation and ETL jobs in support of a global data warehouse. Development of new ETL/data transformation jobs, using PySpark and IBM DataStage in AWS. Enhancement and support on existing ETL/data transformation ...

We are hiring for Senior Data Engineer (MS Fabric & Telecom) Work location: Bangalore, Karnataka, India Experince: 8 to 10 years Notice: Imdiate to 30 days only Role Overview As a Senior Data Engineer, you will be at the forefront of our data transformation, specifically architecting and building the next generation of ...

... versioning, and storage/compute costs for large-scale workloads. Ensure high-quality solutions through unit testing frameworks and automated validation. Collaborate with business teams to support analytics, reporting, and data science initiatives. Mentor junior engineers, sharing knowledge and promoting engineering excellence.

... huge volumes of data and a short learning curve. Join our exceptional team where you'll tackle challenging problems while working alongside industry-leading data engineering talent. We offer a premium work environment where you can make meaningful contributions, shape the future of data engineering, and enjoy the journey ...

... analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience. ...

... learning systems Research and implement appropriate ML algorithms and tools Develop machine learning applications according to requirements Select appropriate datasets and data representation methods • Run machine learning tests and experiments Perform statistical analysis and fine-tuning using test results Train and retrain ...

... using Python. Strong proficiency in Python and object-orientated programming. Familiarity with RESTful API design and implementation. Experience with relational databases such as MySQL, PostgreSQL. Experience with version control systems such as Git. Familiarity with Docker for containerisation. Experience with microservices ...