SENIOR CONSULTANT in Chennai, भारत

Atos is the Atos Group brand dedicated to AI-powered, secure, end-to-end digital services. Atos designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements.

With more than 52,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core IT systems, accelerate cloud and data transformation, strengthen cybersecurity, and deliver secure digital workplace environments to support its clients, its employees and society. Atos also provides consulting and advisory services through its Atos Amplify brand.
A trusted partner in operating complex and mission-critical environments, Atos supports organizations across highly regulated and sovereign contexts.

About Atos Group

Atos Group is a global leader in digital transformation with c. 54,000 employees and annual revenue of c. €7.2 billion, operating in 54 countries under two brands - Atos for services and Eviden for products and systems. European number one in cybersecurity and a leader in cloud, Atos Group is committed to a secure and decarbonized future and provides tailored AI-powered, end-to-end solutions for all industries. Atos Group is listed on Euronext Paris.

Job Description

Role summary :  Migrate existing Lambda/Dagster/dbt pipelines onto a Glue‑based, Redshift‑centric medallion architecture (S3 Bronze → Redshift Silver → Gold canonical model), embed data quality, lineage, security and CI/CD controls into every pipeline, and mentor engineers through domain‑by‑domain migration waves 

Key responsibilities

• Inventory and baseline current Lambda functions, Dagster pipelines, dbt models, MySQL ODS flows and Kafka feeds, document lineage, schedules, SLAs and failure paths.
• Design and build Glue‑based ingestion, transformation, and cataloguing patterns (Glue jobs, Glue Catalog, Crawlers) with Lambda/Step Functions/Event Bridge orchestration.
• Implement S3 Bronze landing with lifecycle/archive policies, Redshift Silver conformance and Gold canonical data products (Customer, Loan, Collections, Risk).
• Build automated data‑quality gates, reconciliation checks, and source‑to‑report lineage; support the enterprise data dictionary and certification of business‑critical reports
• Implement IAM, AWS‑native encryption, Secrets Manager and Gold‑layer RBAC/least‑privilege access.
• Establish Dev/Test environments, Git‑based CI/CD, schema version control (Liquibase) and controlled release promotion; monitoring and recovery via CloudWatch.
• Migrate and reconcile workloads wave by wave against baselines; decommission ODS dependencies and replace reverse flows with governed interfaces.
• Optimise Redshift performance and cost (WLM, sort/Dist keys, materialised views).
• Mentor engineers, own technical quality assurance of deliverables, and work with Data Owners/Champions and Atos architects in an Agile setup.

Mandatory skills

• 10+ years in data engineering, 5+ Experience in AWS data platforms.
• Amazon Redshift (deep): data modelling, performance tuning, WLM, RBAC, external schemas/Spectrum.
• AWS Glue (jobs, Glue Catalog, Crawlers) and hands‑on medallion (Bronze/Silver/Gold) implementation on S3 + Redshift.
• AWS Lambda, Step Functions, S3, IAM, CloudWatch, Secrets Manager.
• Advanced SQL, dimensional/canonical data modelling, ETL/ELT frameworks.
• Python (primary) — PySpark for Glue jobs.
• MySQL (operational data store) and CDC/batch extraction patterns.
• DBT— must be able to read, reverse‑engineer, and migrate existing dbt models.
• Data‑quality frameworks, reconciliation, and lineage/metadata practices.
• Git, CI/CD pipelines, database schema version control (Liquibase or equivalent), Dev/Test/Prod promotion.
• Leadership, mentoring, stakeholder management; ability to work independently in Agile.

Nice to have

• Dagster orchestration — for AS‑IS discovery and migration.
• Kafka / event‑driven streaming ingestion.
• Apache Iceberg on S3, Apache Spark/EMR
• Tableau, Metabase serving‑layer knowledge.
• Infrastructure as Code (Terraform/CloudFormation).
• Data‑governance tooling (Glue Data Quality, Data Zone, Lake Formation).
• UK financial‑services experience: IFRS 9, BCBS 239, FCA/PRA reporting, UK GDPR.
• Preparing governed datasets for AI/ML use cases.

Here at Atos, diversity and inclusion are embedded in our DNA. Read more about our commitment to a fair work environment for all.

Atos is a recognized leader in its industry across Environment, Social and Governance (ESG) criteria. Find out more on our CSR commitment. 

Choose your future. Choose Atos.