Loading description…

Lead Data Engineer SQL AWS in Hyderabad, India - Jobeax

Lead Data Engineer SQL AWS in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.

We are a Sports & Entertainment Marketing business. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Our platforms and services are trusted by over 1000 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike, and Amazon. We are over 1000 people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.
Two Circles is looking for a Data Engineer to join our dynamic KORE Intelligence Platform team. In this role, you'll be a key part of our Partnership Intelligence Measurement Team that specializes in the ingestion, transformation, and storage of large-scale social and broadcast data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence.
We are seeking a Lead Data Engineer to join our Measurement team within the Partnership Intelligence Platform. In this role, you will provide technical leadership for the team while remaining hands-on with our data platform and pipelines.
You will help define technical direction, lead the design and evolution of our data architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who is passionate about data and infrastructure, comfortable making and communicating technical decisions, and interested in continuously improving our architecture, engineering practices, and technology stack.
Provide technical leadership for the Data Engineering team, helping establish technical direction, engineering standards, and best practices while remaining hands-on with the platform.

Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform.
Design and implement data pipelines with a clear focus on data quality and reliability.
Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.
Contribute to our DevOps culture and participate in ownership of our designs through production operations.
Support the ongoing maintenance and operations of the data platform.

Net / C#

Python
AWS or similar
Snowflake

~ SQL

Experience
8+ years of software engineering experience with a strong data focus, including designing, building, and operating production data systems in fast-paced environments.
Demonstrated experience providing technical leadership within an engineering team, including guiding technical direction, leading design discussions, and supporting engineers through complex technical decisions.
Experience designing and evolving data architectures and large-scale data pipelines, including making and communicating architectural decisions and trade-offs.
Experience mentoring engineers and helping raise engineering standards and technical capabilities across a team.
Experience leading technical initiatives that span multiple engineers, systems, or teams, from technical discovery and design through implementation and production operation.
Strong experience writing, debugging, optimizing, and reviewing database queries and data-processing workloads.
Strong experience with object-oriented programming and software engineering practices, preferably using Python and C#/.NET.
Strong experience building and operating cloud infrastructure and services, preferably AWS.
Experience with modern data platforms and orchestration technologies such as Snowflake and Airflow.
Experience establishing or improving engineering practices such as automated testing, CI/CD, observability, monitoring and alerting, code reviews, documentation, and production readiness.
Experience identifying opportunities for automation and implementing solutions that reduce repetitive operational work, improve developer experience, and increase platform reliability.
Experience collaborating with Product Management and technical and non-technical stakeholders and communicating complex technical topics, risks, and trade-offs clearly.

Strong experience designing, building, and operating data pipelines using orchestration and batch-processing technologies such as Apache Airflow.

Strong proficiency with Snowflake and MS SQL Server, including data modeling, query optimization, performance troubleshooting, and production operations.
Proficiency in Python and C#/.NET. Strong experience designing and integrating with APIs, including considerations such as scalability, rate limiting, retries, idempotency, error handling, and observability.
Strong experience with containerization technologies such as Docker and deploying containerized workloads in cloud environments.
Experience with monitoring and observability tools such as New Relic, including defining appropriate metrics, alerts, and operational monitoring for data pipelines and services.
Experience designing effective automated testing strategies, including unit, integration, and data-quality testing, using frameworks such as PyTest.
Strong understanding of distributed systems concepts relevant to data platforms, including concurrency, messaging, failure handling, retries, idempotency, consistency, and scalability.
Ability to evaluate existing architectures, identify technical risks and limitations, and propose pragmatic improvements or modernization strategies.

Apply to vacancy

Similar vacancies

More like this role

Arrive

Lead Data Engineer SQL AWS

1 day ago

... requirements Experience: 8+ years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: ...

India, Bengaluru

Zeno

Data Engineer (AWS, SQL)

1 day ago

$11 USD

... with Lowercarbon, Silicon Valley's leading climate tech venture fund, Toyota Ventures, the VC of the world's largest automotive company, and 4DX Ventures, a leading early-stage investor in Africa. Zeno is seeking a highly skilled and hands-on Data Engineer to design, build, and scale our global data ecosystem. Sitting ...

India, Bengaluru

Dun & Bradstreet

Data Engineer (AWS, SQL)

1 day ago

... 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted environments and cloud platforms such as AWS, Azure, or similar (preferred). - Ability to work ...

India, Rāniganj

BlackBox

Data Engineer (AWS, SQL)

1 day ago

Full-time

... and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you! In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. ...

India, Mumbai

PayPay India

Data Engineer (AWS, SQL)

1 day ago

... managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite. We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization. Create and manage robust data ingestion pipelines leveraging Databricks, ...

India, Gurugram

monk's hill ventures

Data Engineer (AWS, SQL)

2 days ago

Full-time

... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...

India, Bengaluru

Appsierra Group

Data Engineer (AWS, SQL)

2 days ago

... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...

India, Pune

Auriga IT

Data Engineer (AWS, SQL)

3 days ago

... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...

India, Jaipur

altysys

Data Engineer (AWS, SQL)

3 days ago

On-site

... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...

India, Gurugram

Squareroot Consulting Pvt Ltd

Lead Data Analyst - SQL/Python

3 days ago

We are seeking an experienced Lead Data Analyst to work on large-scale Energy & Utilities datasets. The ideal candidate will be responsible for analyzing tariff and pricing data, building data models, automating workflows, and delivering actionable insights to support business decisions.Role: Lead Data AnalystExperience: ...

India, Pune

PKO BP

Data Engineer (SQL, C#)

1 day ago

... preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and ...

India, Pune

Andor Tech

Data Analytics Engineer SQL

1 day ago

Contract

... Contact: View phone number on https://jobeax.com/link/8om4ubga9gvjbUNE #Hiring #DataEngineer #SeniorDataEngineer #AzureDatabricks #Databricks #PySpark #PythonDeveloper #AzureCloud #DataEngineering #BigData #ADF #ADLS #SQL #BangaloreJobs #TechHiring #AndorTech #HiringNow #DataPlatform #CloudEngineering #CareerOpportunity

India, Bengaluru

infovision inc.

Data Engineer with SQL

1 day ago

Full-time

... and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management ...

India, Pune

Azilen Technologies

Senior Data Engineer - SQL

3 days ago

... Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing ...

India, Ahmedabad

Straive

Data Analytics Engineer SQL

4 days ago

... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.

India, Pune

Referrals Only

Lead Data Engineer - Big Data

1 day ago

On-site

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to ...

India, Bengaluru

Mastercard

Lead Data Engineer - Big Data

3 days ago

... partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Lead Data Engineer Who is Mastercard Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital ...

India, Pune

Valuelabs

Senior Data Engineer - AWS

Today

... Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, IAM. Workflow orchestration tools such as Airflow and AWS Step Functions. Experience with NoSQL databases and data stores. Understanding of SDLC, CI/CD, code reviews, testing, and software architecture best practices. Preferred Candidate Profile: A hands-on Data Engineer with ...

India, Rāniganj

ganit inc.

Senior Data Engineer - AWS

1 day ago

On-site

... decision velocity and minimizing decision risk for enterprises ambitious enough to make data their voice. Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion. Cloud Data Migration Leadership : Lead cloud migration projects, ...

India, Bengaluru