Data Engineer - Assistant Manager in Chennai, भारत
Kavi Software Technologies Private Limited
Full-timeStandard weekly hours
Chennai, भारत
We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that power analytics, reporting, and machine learning initiatives across the organization. The ideal candidate has a strong foundation in data modelling, distributed systems, and cloud-based data platforms, with a track record of delivering reliable, high-performance data solutions.
Key Responsibilities:
Design, build, and optimize scalable ETL/ELT pipelines to ingest, transform, and load data from diverse sources (databases, APIs, streaming platforms, third-party systems).
Develop and maintain data warehouse/data lake architectures, ensuring data quality, consistency, and reliability
Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver well-structured, accessible datasets
Build and maintain batch and real-time streaming data pipelines using tools like Apache Spark, Kafka, or Airflow
Implement data quality checks, monitoring, and alerting to ensure pipeline reliability and data integrity
Optimize database and query performance for large-scale datasets
Design and maintain data models (conceptual, logical, physical) and schemas that support analytics and application needs
Work with cloud platforms (AWS/Azure/GCP) to manage data infrastructure, storage, and compute resources
Implement and enforce data governance, security, and compliance best practices
Participate in code reviews, CI/CD pipeline development, and infrastructure-as-code practices
Document data pipelines, architecture, and processes for team knowledge sharing
Troubleshoot and resolve production data pipeline issues in a timely manner
Required Skills & Qualifications
Bachelor's degree in Computer Science, Engineering, or a related field
8+ years of hands-on experience as a Data Engineer or in a similar role
Strong programming skills in Python and/or Scala; solid SQL expertise
Experience with ETL/ELT tools and orchestration frameworks (Apache Airflow, dbt, Luigi, or similar)
Hands-on experience with big data technologies (Apache Spark, Hadoop, Kafka)
Proficiency with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, Cassandra, DynamoDB)
Experience working with cloud data platforms and services (AWS Redshift/Glue/S3, Azure Data Factory/Synapse, GCP BigQuery/Dataflow)
Solid understanding of data modeling concepts — entity relationships, cardinality, normalization, and dimensional modeling (star/snowflake schemas)
Experience with data warehousing solutions (Snowflake, Redshift, BigQuery, Databricks)
Familiarity with version control (Git) and CI/CD practices
Understanding of data governance, security, and privacy best practices (GDPR, data masking, access controls)
Strong problem-solving skills and ability to work with large, complex datasets
... data engineering.- 4+ years of experience designing and building data ingestion, processing, and analytical pipelines using SQL Server, Azure Synapse, Azure Databricks, and Microsoft Fabric.- Hands-on experience implementing ETL and data processing using Microsoft Fabric, OneLake, ADLS, Azure Data Factory, and Azure Functions.- ...
Job Description : The Assistant General Manager - Data & Analytics will demonstrate strong competencies across the following : - Ensures alignment of the Tech strategy, vision, and portfolios with business vision across diverse Business units.- Manage and oversee data & analytics Technology portfolio, drive effective usage ...
... data engineering.- 4+ years of experience designing and building data ingestion, processing, and analytical pipelines using SQL Server, Azure Synapse, Azure Databricks, and Microsoft Fabric.- Hands-on experience implementing ETL and data processing using Microsoft Fabric, OneLake, ADLS, Azure Data Factory, and Azure Functions.- ...
... purpose - The Data Platform Engineer Manager is responsible for designing, building, operating, and continuously improving enterprise‑scale , Databricks based data mesh platform at Syngenta. - This role focuses on platform reliability, scalability, security, and enablement of data engineers, analytics, and data science teams ...
... portfolios. Beghou also deploys proprietary and third-party technology solutions to help companies forecast performance, design territories, manage customer data, organize, and report on medical and commercial data, and more. Headquartered in Evanston, Illinois, we have 10 global offices. Our mission is to bring together ...
Amgen seeks a Senior Manager Data Engineer to lead data strategy design and implementation within the Sales Insight department. The role involves architecting cloud-based data platforms, managing a data engineering team, and establishing governance standards while maintaining hands-on technical expertise. Responsibilities ...
... Deliverables Role Overview As part of the Mahindra Auto Accessories team, Manager – 3D Data Engineer will be responsible for developing, managing, and maintaining engineering CAD data for the Accessories portfolio. This role will support product development programs by ensuring accurate digital models, engineering documentation, ...
Job Summary: If you are a Procurement specialist, Emerson has an exciting role for you! We are looking for a Senior Engineer/Assistant Manager to work for our India Pressure Management Business unit, Mahindra World City, Chengalpattu location. You will ensure the right materials arrive on time to avoid factory operation ...
... optimization initiatives through strategic sourcing, supplier development, rate contracts, and alternate vendor identification. - Collaborate cross-functionally with Engineering, Projects, Planning, Finance, and Global Procurement teams to support business objectives and successful project execution. - Prepare techno-commercial comparison ...
... engineering, manufacturing excellence, and customer-focused project execution. Position Overview: We are seeking an experienced Planning & Project Control Engineer with 10–12 years of experience in project planning, production planning, and project controls within the heavy engineering, fabrication, pressure vessel, process ...