Loading description…

Lead Data Engineer SQL AWS in Hyderabad, India - Jobeax

Lead Data Engineer SQL AWS in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.

We are a Sports & Entertainment Marketing business. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Our platforms and services are trusted by over 1000 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike, and Amazon. We are over 1000 people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.
Two Circles is looking for a Data Engineer to join our dynamic KORE Intelligence Platform team. In this role, you'll be a key part of our Partnership Intelligence Measurement Team that specializes in the ingestion, transformation, and storage of large-scale social and broadcast data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence.
We are seeking a Lead Data Engineer to join our Measurement team within the Partnership Intelligence Platform. In this role, you will provide technical leadership for the team while remaining hands-on with our data platform and pipelines.
You will help define technical direction, lead the design and evolution of our data architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who is passionate about data and infrastructure, comfortable making and communicating technical decisions, and interested in continuously improving our architecture, engineering practices, and technology stack.
Provide technical leadership for the Data Engineering team, helping establish technical direction, engineering standards, and best practices while remaining hands-on with the platform.

Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform.
Design and implement data pipelines with a clear focus on data quality and reliability.
Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.
Contribute to our DevOps culture and participate in ownership of our designs through production operations.
Support the ongoing maintenance and operations of the data platform.

Net / C#

Python
AWS or similar
Snowflake

~ SQL

Experience
8+ years of software engineering experience with a strong data focus, including designing, building, and operating production data systems in fast-paced environments.
Demonstrated experience providing technical leadership within an engineering team, including guiding technical direction, leading design discussions, and supporting engineers through complex technical decisions.
Experience designing and evolving data architectures and large-scale data pipelines, including making and communicating architectural decisions and trade-offs.
Experience mentoring engineers and helping raise engineering standards and technical capabilities across a team.
Experience leading technical initiatives that span multiple engineers, systems, or teams, from technical discovery and design through implementation and production operation.
Strong experience writing, debugging, optimizing, and reviewing database queries and data-processing workloads.
Strong experience with object-oriented programming and software engineering practices, preferably using Python and C#/.NET.
Strong experience building and operating cloud infrastructure and services, preferably AWS.
Experience with modern data platforms and orchestration technologies such as Snowflake and Airflow.
Experience establishing or improving engineering practices such as automated testing, CI/CD, observability, monitoring and alerting, code reviews, documentation, and production readiness.
Experience identifying opportunities for automation and implementing solutions that reduce repetitive operational work, improve developer experience, and increase platform reliability.
Experience collaborating with Product Management and technical and non-technical stakeholders and communicating complex technical topics, risks, and trade-offs clearly.

Strong experience designing, building, and operating data pipelines using orchestration and batch-processing technologies such as Apache Airflow.

Strong proficiency with Snowflake and MS SQL Server, including data modeling, query optimization, performance troubleshooting, and production operations.
Proficiency in Python and C#/.NET. Strong experience designing and integrating with APIs, including considerations such as scalability, rate limiting, retries, idempotency, error handling, and observability.
Strong experience with containerization technologies such as Docker and deploying containerized workloads in cloud environments.
Experience with monitoring and observability tools such as New Relic, including defining appropriate metrics, alerts, and operational monitoring for data pipelines and services.
Experience designing effective automated testing strategies, including unit, integration, and data-quality testing, using frameworks such as PyTest.
Strong understanding of distributed systems concepts relevant to data platforms, including concurrency, messaging, failure handling, retries, idempotency, consistency, and scalability.
Ability to evaluate existing architectures, identify technical risks and limitations, and propose pragmatic improvements or modernization strategies.

Apply to vacancy

Similar vacancies

More like this role

Addepar

Data Support Analyst - SQL

4 days ago

Remote
Hybrid
On-site

1400 / year

... product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage with Engineering & Product when needed. Partner with Account Managers, ...

India, Pune

Weekday AI

Data analyst - sql python

5 days ago

Full-time

... dashboards. - Expert-level proficiency in SQL , including complex queries, joins, aggregations, subqueries, and data manipulation. - Strong understanding of data preparation, data modelling, reporting, and visualisation principles. - Experience working with financial, operational, risk, or business performance data. - ...

India, Bengaluru

ADM

Senior SQL Data Analyst

5 days ago

... demonstrate technical and non-technical information, ideas, procedures, and processes Prior experience in an SAP and/or Informatica driven environment Ability to use SQL to analyze data Bachelor's degree related to Information Systems, Business or other relevant academic discipline with a minimum 4 years job experience in IT or ...

India, Bengaluru

letzbizz

Data Engineers required ASAP

4 days ago

Full-time

... RDS, Redshift Experience with stream-processing systems: Experience with object-oriented/object-function scripting languages: Python, Java, etc. Knowledge of data pipelines and workflow management tools like Airflow Hiring #SeniorDataEngineer #BigData #ChennaiJobs #ETL #AWS #SQL #DataPipelines #DataEngineering #Python #Java ...

India, Chennai

Infinite Computer Solutions India Pvt. Ltd.

Technical Lead (AWS, Java)

2 days ago

Job Description Data Ingestion Dev â€' LO / Lights-On Support Role OverviewFull-stack engineer supporting AWS-based data ingestion platform, focused on production stability, incident handling, and https://jobeax.com/link/fmLHLtcOCCQWBo1w ResponsibilitiesOwn L1/L2 production support for APIs, services, and data pipelinesMonitor ...

India, India

Appsierra Group

AWS Lead Java Developer

5 days ago

... to Java. Proficient in Spring, Spring Boot, Spring REST, Spring Cloud Config, and Spring WebFlux. Experience with Test Driven Development (TDD). Competent in SQL with RDBMS systems like Oracle, PostgreSQL, and MySQL. Familiarity with NoSQL databases, especially MongoDB or Cassandra, is a plus. Skilled in ORM frameworks ...

India, Noida

Applied Data Finance

Applied Data Finance - Data Architect

3 days ago

... Modeling.- Data Platform Engineering : Apache Spark (PySpark), Python, Advanced SQL, ETL/ELT, Batch & Streaming Processing, Pipeline Design, Performance Tuning.- Data Integration : Apache Kafka, AWS DMS, REST APIs, CDC.- Metadata & Governance : Apache Atlas (preferred), Metadata Management, Data Catalog, Business Glossary, ...

India

Spectrum Consulting

Reporting & Analytics Lead - Python/SQL

4 days ago

Experience : 6 - 10 YearsRequired Technical Skills : - Databricks (Data Engineering, SQL Warehouses, Delta Tables, Data Validation)- Python (Pandas, Automation, Data Processing, Reporting Solutions)- SQL (Advanced querying, optimization, joins, window functions, RCA)- Tableau (Dashboard development, performance tuning, ...

India, Chennai

Spectrum Consulting

Reporting & Analytics Lead - Python/SQL

5 days ago

India, Gurugram

Weekday AI

Lead Data Scientist

2 days ago

Full-time

Rs 25 - 30 lakhs p.a.

... scalable, data-driven solutions. In this role, you will work closely with engineering, product, analytics, and business teams to identify opportunities where data and AI can create measurable impact. You will also provide technical leadership, mentor data scientists, and contribute to the design and evolution of machine ...

India, Hyderabad

Novo Nordisk

Data Governance Lead

3 days ago

... privacy, ethics and compliance requirements and embed them in day-to-day governance practice. Who you’ll work with You will join the Data and AI Foundation and lead the Data Engineering Enablement team within Novo Nordisk Enterprise IT. The team brings together AI, data and software engineers, business analysts, data architects ...

India, Bengaluru

PMC Commerce

Data/SQL Analyst - Power BI

1 day ago

... Strong experience with SQL and working with APIs is required. Familiarity with data warehousing concepts and tools such as Azure Data Factory or equivalent. Data Handling: Expertise in data engineering, including data cleaning, transformation, and preparation for analysis. Knowledge of data modelling, database design, ...

India, Vadodara

zorba ai

Senior Data Analyst - Tableau, SQL

2 days ago

... DAX expressions.  Perform storyboarding to structure analytical insights and present clear, compelling narratives to stakeholders.  Collaborate closely with Data Engineering teams by providing clear and detailed requirements.  Ensure data accuracy, consistency, and adherence to best practices in reporting and analytics ...

India, India

Shell

Data Scientist (Python, ML, SQL)

2 days ago

Hybrid

... science workloads is desirable. - Demonstrated commitment to technical rigor and model explainability through Responsible AI practices. - Proficiency in Python, SQL, and data engineering for analytical / process data modeling. - Experience in machine learning, deep learning, or optimization algorithms applied to real-world ...

India, Chennai

BDO India

Data Scientist (Python, ML, SQL)

3 days ago

Full-time

... Requirements Experience: 4 to 6 years of hands-on professional experience Education: BE/B.Tech/ME/M.Tech/MCA/MSc IT Primary Skills (must have): Strong Azure or AWS knowledge Strong working knowledge on Data Science, Artificial Intelligence, Machine Learning Secondary Skills (good to have): SQL, Python Professional Attributes: ...

India, Mumbai

IMI

Data Scientist (Python, ML, SQL)

3 days ago

... strategy, standards, and best practices. Present findings, recommendations, and AI roadmaps to leadership teams. Provide technical guidance and mentoring to junior data scientists and analysts. Collaborate with global teams and external partners to deliver data-driven solutions. Advanced knowledge of Python, SQL, and modern data ...

India, Bengaluru

AngelONE

Data Scientist (Python, ML, SQL)

3 days ago

... Understand data landscape Perform ad-hoc analysis and present results in a clear manner Work on the full lifecycle of machine learning development including sourcing, dataset curation, feature engineering, model training, model tuning, and offline & online experimentation Strong programming skills with minimum 3-6 years of experience ...

India, Bengaluru

FundsIndia

Data Scientist (Python, ML, SQL)

3 days ago

... Storytelling- translate technical findings into clear, actionable recommendations for non-technical stakeholders, including senior leadership. 3-4 years of experience in data science, analytics, or a related quantitative role, ideally handling large, real-world datasets. - Strong hands-on skills in Python and SQL, with solid fundamentals ...

India, Bengaluru

ADA

Senior Data Analyst (SQL & Python)

4 days ago

... of experience in data analytics or a related field Strong hands-on experience with: SQL Python Power BI and/or Tableau Solid understanding of data modeling, data cleaning, and transformation techniques Experience working with structured and unstructured datasets Familiarity with statistical analysis and data visualization ...

India, Bengaluru

anko gcc

Data Scientist (Python, ML, SQL)

4 days ago

... team drives competitive advantage by providing the best-in-class data, analytics, and insights for the Kmart Group. By using the latest cloud platforms tools, data engineering practices, and data science methods, the team is paving the way for a data culture within the organization, which leads to improved sales, cost savings, ...

India, Bengaluru