Data Engineer - ETL/Data Pipelines in Mumbai, India
consultancy
India, Mumbai
Data Engineer - ETL/Data Pipelines in Mumbai, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Summary :Own design, reliability and performance of data pipelines, ETL/ELT workflows, data marts, APIs, data quality checks and integration layers, so BI and AI teams receive clean, trusted, timely https://jobeax.com/link/CYOxrWtv7KilJskJ Responsibilities :- Design and maintain pipelines, ETL/ELT workflows, streaming, data lake and integration layers.- Establish data quality checks and monitoring and drive change in the organization.- Own production reliability and performance; drive incidents to root cause.- Mentor and review the work of the junior Data Engineer.- Partner with Data Scientist, AI Engineers and Business Analyst and support them with data.- Handle real-time and batch data https://jobeax.com/link/azWbZnxGZ1bWkVxQ We Expect From You :- Build pipelines that are reliable and monitored, not just functional on day one.- Drive production incidents to root cause, not just a quick patch.- Communicate data availability and quality issues to BI and Analyst teams before they discover them downstream.- Balance speed of delivery with long-term https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
... Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines to integrate structured, semi-structured, and unstructured data from multiple sources Implement ETL/ELT processes ...
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...
... with other data engineers, data scientists, and business colleagues. The ideal candidate is a driven learner who develops and sharpens skills building data pipelines, transforming raw data into useful data systems, and optimizing the data delivery architecture. Responsible to design, build, refactor, and maintain data pipelines ...
Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. The below role is for our ...
... business faces, which can be better understood with data Compile and analyze data related to business' issues Develop clear visualizations to convey complicated data in a straightforward fashion Qualifications - Bachelor's or Master's degree in Statistics or Applied Mathematics or equivalent experience - 1 - 2 years' Data ...
... architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines leveraging modern big data frameworks ...
... for a data professional to join our Data Engineering team. Independently execute data engineering projects Undertake processing of structured and unstructured data Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact ...
... technical solutions and maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline design patterns - PySpark: Proven hands-on experience developing data pipelines using PySpark, including DataFrames API, Spark ...
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
Data Engineer – Python & Pyspark (AWS) Exp: 6+ yrs Location : Chennai Client Place Guindy Work Mode : All 5 days Role Overview We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You ...
... analytics engineering . The ideal candidate has strong expertise in Apache Spark, Kafka, Snowflake, and AWS/Azure . Build and maintain scalable batch and real-time data pipelines for fraud analytics. Develop and optimize Spark-based data processing frameworks. Implement efficient data ingestion frameworks and integrate multiple ...
... https://jobeax.com/link/mYvMZkpRFRzMWb6X company culture revolves around maximizing decision velocity and minimizing decision risk for enterprises ambitious enough to make data their voice. Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion. Cloud Data Migration ...
... contributing to large-scale data projects on Google Cloud Platform. You will work closely with senior engineers and data analysts to build and maintain robust data pipelines, helping to turn raw data into actionable https://jobeax.com/link/d6zqLcygnqsI43u7 Responsibilities:- Develop, test, and maintain data pipelines and ETL/ELT ...
... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
... Responsibilities : - Architect and maintain complex data models that serve as the foundation for enterprise-wide reporting and advanced analytics, ensuring high data integrity and performance.- Lead the end-to-end design and implementation of scalable ETL/ELT pipelines within the Snowflake environment to streamline data ingestion ...
... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...
... by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. ...
... accuracy across the network. Define and maintain strict access control, governance, and data privacy standard practices across the global insights platform. Engineering Hygiene & DevOps Packaged and deploy data services using Docker and Kubernetes. Maintain elegant CI/CD automation pipelines for data code deployments and ...
... affordable healthcare. Build and manage digital analytics datasets and reporting solutions Develop data pipelines and analytical reporting frameworks Support data validation, UAT, process improvements, and analytics initiatives. Experience & Qualification: Python Power BI & Dashboard Development Data Modeling & Data Validation ...
... team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics to monitor application ...