8,598 big data engineer jobs in India.

... Engineer with strong Azure cloud competencies to join our dynamic https://jobeax.com/link/V9v5V1Tltw2JcjY6 Responsibilities : 1. Architecture and Design for Data Engineering and Machine Learning Projects : - Establishing architecture and target design for data engineering and machine learning projects.2. Requirement Analysis, ...

... data solutions with business goals. Collaborate with data scientists, analysts, and business teams to deliver actionable insights. 8+ years of experience in Data engineering. Strong expertise in GCP and BigQuery. Hands-on experience with Airflow for workflow orchestration. Proficiency in Java or Python for data processing ...

... experience with Unix/Linux and be comfortable working from the command line. This is essential, there are no GUIs here. Good fundamental computer science / software engineering skills and knowledge, particularly operating system internals, resource management, and networking. Previous experience working with databases and/or Open-Source ...

... motivated Data Engineer to join our growing data team. In this role, you will help design, develop, and maintain data pipelines and systems that make reliable data available to analysts, applications, and business teams. You will collaborate with data analysts, software developers, database engineers, and business stakeholders ...

... monitoring, logging, alerting, incident response, and clean CI/CD via Azure DevOps. - Translate ambiguous business asks into reliable, documented, maintainable data products. 3+ years in data engineering, with significant Spark / PySpark at production scale. - Strong SQL and dimensional data modeling (Kimball-style star schemas, ...

... external data and processes to answer specific business questions and identify opportunities for improvement - Build processes supporting data transformation, data structures, metadata, dependency, and workload management - Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores ...

... Implement data quality and governance processes to ensure the accuracy, consistency, and reliabilityof data YOUR PROFILE: - University degree in computer science, Engineering, or a related technical field - 8 – 10+ year experience as a data engineer or in a similar data-intensive role - Proficient knowledge in ETL, Data Lake, ...

... critical data ingestion and processing capabilities, improve data quality and reliability, and develop AI-powered solutions for complex real-world healthcare data challenges. We are looking for an engineer who combines strong Python and data engineering expertise with cloud-native development, production ownership, and ...

... DataStage, Informatica, Spark or related . ➢ Experience with other languages and concepts: .NET, C#, Python, R, Java, HTML, SSRS, AWS, Azure, Spark, REST APIs, Big Data, ETL, Data Pipelines, Data Modelling, Data Analytics, BI, Data Warehouse, Data Lake or related. ➢ Strong familiarity with EDC Systems: Rave, Trial Master, ...

... requirements and technical execution, ensuring high-quality solution delivery Mentor junior scientists on coding standards, experimental design, and model ethics Audit data quality and process integrity across the entire modelling lifecycle Mentor and guide junior data scientist Stay updated with the latest trends in data science ...

Please find the below JD for Data Engineering. Position: Data Engineer Experience: 4 to 10 Years experience in PySpark and Data bricks Location : Hyderabad Overview: In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data sources, and implementing strong validation ...

... intersection of data infrastructure and business insight delivery, requiring the Data Engineer to design and build robust data pipelines while also translating data into meaningful visualizations for stakeholders across the organization. The ideal candidate has strong technical skills, experience with big data technologies, ...

... and postmortems, identifying observability gaps and driving continuous improvement. - Relevant certifications such as New Relic APM Professional, Reliability Engineer – Professional, Splunk Admin, or GCP Associate Cloud Engineer are a plus. - Our success as one of the biggest players in online travel is all thanks to our ...

... mitigating risks, managing dependencies, and communicating status and timelines to meet delivery expectations. Work closely with cross-functional teams (consultants, data science, data engineers) to ensure successful project delivery. Contribute to the development of internal frameworks, templates, and accelerators for data science ...

About this Position The Data Engineer supports the development and operation of Henkel's enterprise metadata platform, DataHub. The role focuses on building scalable data engineering and governance solutions that connect key enterprise platforms into one centralized ecosystem serving global data consumers. As part of a ...

Role Overview :The Senior Data Engineer Financial Integrations will be responsible for building, operating and continuously improving reliable data and system integrations across member institution Core Banking Systems (CBS), firm's central data and technology platforms, payment and financial systems, regulatory interfaces ...

... large databases in a business environment.- Experience with building data pipelines and applications to stream and process datasets at low latencies.- Fluent with Big Data technologies like Spark, Kafka and Hive.- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service ...

... 75%.4. Package & Hand Off to Engineering (15% of time) : For validated POCs, prepare structured handoff documentation : workflow diagrams, prompt templates, data sources, guardrails, integration points, and success metrics. Collaborate with the engineering team to translate your prototype into a scalable, production-grade ...

... Experience with MongoDB, Redis, Cassandra, and Elasticsearch . Experience with Docker, Kubernetes, and CI/CD pipelines. Familiarity with DevOps practices and distributed systems. Exposure to machine learning and big data technologies. Experience & Education Experience: 8-12 years Bachelor's degree in Engineering or equivalent

... trust Okta Workflows to help their organizations work faster, boost revenue, and stay secure. Position Description We are looking for a full-stack JavaScript engineer that has a deep understanding of both backend service engineering and user interface development. In this role, you will be a vital part of our Workflows Integrated ...