Vacancy description
ELGI EQUIPMENTS LIMITED
India, Bengaluru
Senior Data Engineer - AWS, DevOps in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Purpose This role is responsible for driving enterprise-wide data engineering strategy. It ensures the design, implementation, and continuous improvement of data pipelines, scalable and reusable frameworks, and implement data governance and data quality engines. The position enables trusted, governed data across systems, supporting analytics, compliance, and business operations at ELGi.
Data Engineering & Architecture
Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP.
Develop modular, reusable data engineering frameworks for ingestion, transformation, and orchestration.
Build Spark, SQL, and Python workflows in Databricks.
Optimize compute, storage, and pipeline performance for cost efficiency.
Data Quality, Governance & Security
Build custom data quality (DQ) frameworks with rule-based validation.
Apply row/column-level security and data masking policies.
Manage secure secrets using Azure Key Vault / AWS Secrets Manager.
Pipeline Reliability & DevOps
Set up monitoring, logging, and alerting frameworks for pipeline health.
Drive test-driven data engineering (unit, integration, regression tests).
Use Azure DevOps and GitHub for CI/CD automation and version control.
Collaborate with Data Engineering, Data Architects, Analytics teams, and vendors.
Partner with ERP, SCM, Logistics, CRM, IoT, and Quality business teams.
Guide architectural decisions for data platform modernization.
Drive innovation in ingestion, transformation, governance, and cloud engineering.
Required Skills and Experience
Similar vacancies
Accenture
... outcomes at scale, ensuring alignment between technical objectives and business priorities. In addition, experience with mainframe-to-cloud migration tools such as AWS Mainframe Migration and Google MDMC is highly desirable. Familiarity with code analysis platforms including CAST Highlight and BluAge, as well as DevOps practices ...
India, Bengaluru
NatWest Group
Join us as a DevOps Engineer This is an opportunity for a driven individual to take on an exciting new career challenge You'll focus on enhancing the integration of development and platform activities to improve deployment and system reliability It's a chance to have a tangible effect on our function, put your existing ...
India, Gurugram
$11 USD
... accuracy across the network. Define and maintain strict access control, governance, and data privacy standard practices across the global insights platform. Engineering Hygiene & DevOps Packaged and deploy data services using Docker and Kubernetes. Maintain elegant CI/CD automation pipelines for data code deployments and ...
India, Bengaluru
Dun & Bradstreet
... join our team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics to monitor application ...
India, Rāniganj
Diligent Corporation
700k
... experiences. Contribute to AI-enabled features and use AI development tools responsibly to improve coding, testing, research, documentation, and delivery. Apply sound engineering practices across architecture, performance, security, testing, debugging, and maintainability. Deploy and operate services using AWS and CI/CD workflows, ...
India, Bengaluru
BlackBox
... and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you! In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. ...
India, Mumbai
PayPay India
... managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite. We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization. Create and manage robust data ingestion pipelines leveraging Databricks, ...
India, Gurugram
monk's hill ventures
... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...
India, Bengaluru
wowJobs
... architects, analysts, developers, and business stakeholders to understand data requirements.- Ensure data quality, security, governance, and best practices across data engineering https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack:- Python, PySpark, SQL, AWS Glue, AWS Glue Data Catalog, AWS Lambda, Amazon S3, AWS Step Functions, ...
India, Pune
Teamware Solutions
... BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) ...
India, Bengaluru
Appsierra Group
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...
India, Pune
Auriga IT
... Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, and preprocessing. Collaborate with cross-functional teams including data analysts and engineers. ...
India, Jaipur
srs consulting inc
Hello, We are hiring for 'Data Engineer with Java' for Pune Location. Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline CI/CD SQL NOTE: We are looking for Immediate joiners(notice period ...
India, Pune
altysys
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
India, Gurugram
delta technology hub
... degree in computer science, Information Systems or related technical field is preferred. Experience working in an airline technology environment is preferred. AWS Certified Solutions Architect – Professional or AWS Certified DevOps Engineer – Professional. Advanced knowledge of Java or another enterprise programming language ...
India, Bengaluru
Ensono
... the lead engineer on large or complex client deploy projects - Act as the lead engineer on product engineering projects to further develop our service - Provide AWS subject matter expertise advice and assistance to pre-sales architects - Installation, configuration, and ongoing management of O/S and AWS services. - Implementing ...
India, Chennai
91social
... with AWS, Dockers and Kubernetes. Should have worked with a scripting language. Should know how to monitor system performance, CPU, Memory. Should be able to do troubleshooting. Should have knowledge of automated deployment Proficient in one programming knowledge - python preferred. Skills:- DevOps, Docker and Kubernetes
India, Bengaluru
... years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: Deep experience ...
India, Bengaluru
Two Circles
... Contribute to our DevOps culture and participate in ownership of our designs through production operations. - Support the ongoing maintenance and operations of the data platform. Net / C# - Python - AWS or similar - Snowflake ~ SQL - Experience - 8+ years of software engineering experience with a strong data focus, including ...
India, Hyderabad
pri india it services private limited
... full application stack, including frontend, backend, and databases. Review requirements, technical designs, and code quality. Conduct code reviews and enforce engineering best practices. Collaborate with Product, QA, DevOps, and stakeholders. Drive Agile delivery, estimations, and sprint planning. Leverage AI tools (Claude, ...
India, Chennai