Loading description…

Lead Data Engineer SQL AWS in Hyderabad, India - Jobeax

Lead Data Engineer SQL AWS in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.

We are a Sports & Entertainment Marketing business. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Our platforms and services are trusted by over 1000 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike, and Amazon. We are over 1000 people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.
Two Circles is looking for a Data Engineer to join our dynamic KORE Intelligence Platform team. In this role, you'll be a key part of our Partnership Intelligence Measurement Team that specializes in the ingestion, transformation, and storage of large-scale social and broadcast data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence.
We are seeking a Lead Data Engineer to join our Measurement team within the Partnership Intelligence Platform. In this role, you will provide technical leadership for the team while remaining hands-on with our data platform and pipelines.
You will help define technical direction, lead the design and evolution of our data architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who is passionate about data and infrastructure, comfortable making and communicating technical decisions, and interested in continuously improving our architecture, engineering practices, and technology stack.
Provide technical leadership for the Data Engineering team, helping establish technical direction, engineering standards, and best practices while remaining hands-on with the platform.

Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform.
Design and implement data pipelines with a clear focus on data quality and reliability.
Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.
Contribute to our DevOps culture and participate in ownership of our designs through production operations.
Support the ongoing maintenance and operations of the data platform.

Net / C#

Python
AWS or similar
Snowflake

~ SQL

Experience
8+ years of software engineering experience with a strong data focus, including designing, building, and operating production data systems in fast-paced environments.
Demonstrated experience providing technical leadership within an engineering team, including guiding technical direction, leading design discussions, and supporting engineers through complex technical decisions.
Experience designing and evolving data architectures and large-scale data pipelines, including making and communicating architectural decisions and trade-offs.
Experience mentoring engineers and helping raise engineering standards and technical capabilities across a team.
Experience leading technical initiatives that span multiple engineers, systems, or teams, from technical discovery and design through implementation and production operation.
Strong experience writing, debugging, optimizing, and reviewing database queries and data-processing workloads.
Strong experience with object-oriented programming and software engineering practices, preferably using Python and C#/.NET.
Strong experience building and operating cloud infrastructure and services, preferably AWS.
Experience with modern data platforms and orchestration technologies such as Snowflake and Airflow.
Experience establishing or improving engineering practices such as automated testing, CI/CD, observability, monitoring and alerting, code reviews, documentation, and production readiness.
Experience identifying opportunities for automation and implementing solutions that reduce repetitive operational work, improve developer experience, and increase platform reliability.
Experience collaborating with Product Management and technical and non-technical stakeholders and communicating complex technical topics, risks, and trade-offs clearly.

Strong experience designing, building, and operating data pipelines using orchestration and batch-processing technologies such as Apache Airflow.

Strong proficiency with Snowflake and MS SQL Server, including data modeling, query optimization, performance troubleshooting, and production operations.
Proficiency in Python and C#/.NET. Strong experience designing and integrating with APIs, including considerations such as scalability, rate limiting, retries, idempotency, error handling, and observability.
Strong experience with containerization technologies such as Docker and deploying containerized workloads in cloud environments.
Experience with monitoring and observability tools such as New Relic, including defining appropriate metrics, alerts, and operational monitoring for data pipelines and services.
Experience designing effective automated testing strategies, including unit, integration, and data-quality testing, using frameworks such as PyTest.
Strong understanding of distributed systems concepts relevant to data platforms, including concurrency, messaging, failure handling, retries, idempotency, consistency, and scalability.
Ability to evaluate existing architectures, identify technical risks and limitations, and propose pragmatic improvements or modernization strategies.

Apply to vacancy

Similar vacancies

More like this role

EDMO Distributors

Senior Software Engineer - Fullstack/Backend

7 days ago

10k

... implement both RESTful APIs and Event-Driven Architectures to support high-scale operations. Data Strategy: Optimize data persistence strategies using a mix of PostgreSQL for relational integrity and MongoDB for flexible document storage. Performance & Scaling: Cloud Native Development: Deploy and manage services across AWS/GCP, ...

India, Pune

weekdayworks

AWS Developer Engineer

2 days ago

Full-time

This role is for one of our clients Industry: IT Services and IT Consulting Company Name: Brillio Seniority level: Mid-Senior level Min Experience: 2+ years Location: Bengaluru JobType: full-time

India, Bengaluru

Cognizant Softvision

Engineer - Java - AWS

3 days ago

... Event-Driven Architecture Message Queue Concepts Microservices Microservices Architecture REST APIs API Development & Integration Database SQL Oracle / PostgreSQL / MySQL Development Practices Object-Oriented Design Design Patterns Unit Testing (JUnit, Mockito) Git Version Control Preferred Skills Azure Cloud or AWS Cloud ...

India, Bengaluru

carpl - radiology ai platform

AWS Security Engineer

5 days ago

On-site
Full-time

We are seeking a highly skilled Security Engineer to design, implement, and maintain robust security systems that protect our organization's digital assets, infrastructure, and networks. In this role, you will focus heavily on securing containerized environments, ensuring orchestrators are locked down, and building trusted, ...

India, Delhi

BluOcean Cyber

AWS Security Engineer

5 days ago

... evidence collection, or audit-readiness workflows. Experience working in consulting, client-facing security roles, or environments requiring strong stakeholder management. Relevant certifications such as CCSP, CCSK, CISSP, AWS Security Specialty, Azure Security Engineer, GCP Security Engineer, CSSP, or similar credentials.

India, Mumbai

Infosys Limited

AWS Network Engineer

5 days ago

... Science Information Technology Electronics Communication or a related discipline - 3 years of experience in network administration network operations or network engineering - Hands on experience with Cisco routers and switches - Technical Skills - Routing - Static Routing ~ OSPF ~ EIGRP - Basic BGP Concepts - Route Redistribution ...

India, Bengaluru

TAC Security

AWS Security Engineer

5 days ago

... Security Perform advanced web application penetration testing aligned with OWASP Top 10 and relevant testing methodologies. Test for vulnerabilities including SQL Injection, XSS, SSRF, IDOR, authentication and authorization weaknesses, insecure deserialization, file-upload vulnerabilities, business-logic flaws, and security ...

India, Delhi

Intopz Technologies Pvt Ltd

AWS Network Engineer

11 days ago

On-site
Full-time

... company values continuous learning, professional growth, and a commitment to quality service delivery. Role Description This is a full-time, on-site Network Engineer role based in Bengaluru. The Network Engineer will be responsible for designing, implementing, and maintaining LAN, WAN, and wireless networks to ensure stable ...

India, Bengaluru

Photon Interactive Private limited

AWS Automation Engineer

11 days ago

... AWS serverless components, EKS, Docker and other services - You have worked in Agile methodologies or iterative development processes - Good understanding of database and data concepts, tools and technologies (Oracle, PL/SQL) - Knowledge of event driven applications leveraging Kafka - Knowledge in Java and Open Source Frameworks ...

India, India

Synergy Marine Group

MID BACKEND/FULLSTACK DEVELOPER

Today

... for a mid-level Full-Stack Engineer (Data Products) to build and operate data-driven applications end-to-end. This role blends data ingestion and pipeline engineering with backend API development (https://jobeax.com/link/JSd7UYCSg572jJDY) and frontend delivery (React/HTML), deployed and operated on AWS. You will own features ...

India, Chennai

Cloudesign Technology

AWS IoT & Backend Engineer

7 days ago

... Policies.- Programming : Python, https://jobeax.com/link/JSd7UYCSg572jJDY, JavaScript/TypeScript.- Backend : FastAPI/NestJS, REST APIs, WebSockets, Microservices.- AWS : IoT Core, SQS, ECS/EC2, S3, ECR, Aurora PostgreSQL, IAM, CloudWatch.- Database : PostgreSQL, SQL, database design, query optimization.- DevOps : Docker, Linux, ...

India, Chennai

CodeChavo

AI Engineer - Python/SQL

5 days ago

... implementation rather than developing new algorithms.- Translate business goals into AI-powered solutions, ensuring technical feasibility through collaboration with squad leads, data scientists, architects, and full stack engineers.- Integrate Google Cloud AI services and models into microservices and workflows to support scalable and ...

India, Pune

Nexla

Software Engineer (Python/SQL)

7 days ago

Hybrid
On-site

... like: monitoring, alerting, incident response, post-mortems. - You use AI tools in your actual work and can say specifically where they help and where they mislead you. Bonus points Working knowledge of AWS or GCP. Data-intensive systems, or the data integration domain. You are comfortable defining scope on the fly and shipping ...

India, Bengaluru

Vensure Employer Solutions

Data Engineer (Big Data)

5 days ago

... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...

India, Thiruvananthapuram

Unified Consultancy Services

SQL Database Architect

6 days ago

Hybrid
On-site
Full-time

... database technologies like Oracle, SQL Server, MySQL, PostgreSQL. - Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus. - Strong knowledge of database performance tuning, indexing, and query optimization. - Hands-on experience with cloud databases (e.g., AWS RDS, Azure SQL, GCP Cloud SQL). - Familiarity ...

India, Rāniganj

Vision Excel Career Solutions

AWS Data Architect - Python/Apache Airflow

6 days ago

Role : AWS Data Architect Job Description :Candidate should possess a deep understanding of big data technologies, cloud services, and data architecture, with a proven track record of leading data-driven projects to successful https://jobeax.com/link/CEKJnNMNtDL19sum Responsibilities :- Lead a team of data engineers, providing ...

India, Hyderabad

DATAECONOMY

Lead Alation Developer - Data Governance & Data Catalog

1 day ago

Hybrid

₹5 INR

... Alation APIs, REST APIs, SQL, and Python . - Monitor and troubleshoot metadata ingestion, crawler jobs, integrations, and catalog issues. - Collaborate with Data Owners, Data Stewards, Data Architects, Data Engineers, and business stakeholders. - Define and implement data governance and data quality standards. - Lead/mentor ...

India

Wissen Technology

Python Database Engineer

5 days ago

Hybrid
On-site

... proficiency in Python , practical cloud experience with AWS , and database engineering in MongoDB . Good to Know Skills: Kubernetes and containerization concepts (Docker). Infrastructure deployment with modern CI/CD frameworks . Relational database querying with PL/SQL . Exposure to AI Best Practices and modern developer tooling

India, Bengaluru

COFORGE LIMITED

Coforge - Database Architect - PostgreSQL/MongoDB

6 days ago

Hybrid
On-site

... for AWS database services.- Lead database modernization, migration, capacity planning, upgrades, and scalability initiatives.- Evaluate and recommend future database technologies and https://jobeax.com/link/kfh0tlAWFidCMbXR Administration : - Install, configure, administer, and support MS SQL Server, PostgreSQL, MongoDB, ...

India, Bengaluru

Lucideus

Senior DevOps Engineer AWS

5 days ago

... optimize cloud costs while maintaining system performance and reliability.- Infrastructure Management : Manage our multi-environment infrastructure deployed in AWS cloud, comprising Dockerized microservices in AWS ECS & various data stores and queueing technologies.- Automation : Leverage modern solutions like Terraform ...

India, Bengaluru