Vacancy description
Referrals Only
India, Bengaluru
Lead Data Engineer - Big Data in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution.
Job responsibilities
You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration.
You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality.
You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems.
You will collaborate with data scientists to design scalable implementations of their models.
You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines.
You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available.
You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
You will be responsible for data governance, data security and data privacy to support business and compliance requirements.
You will define the strategy for and incorporate data quality into your day-to-day work.
Job qualifications
Technical Skills
You have experience in leading the system design and implementation of technical solutions.
Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems.
You have a deep understanding of data modeling and experience with modern data engineering tools and platforms.
You have experience in writing clean, high-quality code using the preferred programming language.
You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting.
You have experience with data visualization techniques and can communicate the insights as per the audience.
You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems.
You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.).
You have experience with GCP cloud.
Professional Skills
You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way.
You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives.
You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them.
You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work.
You enjoy influencing others and always advocate for technical excellence while being open to change when needed.
You are a proven leader with a track record of encouraging teammates in their professional development and relationships.
Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business.
Other things to know
Learning & Development
There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.
About Thoughtworks
Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary.
#LI-Onsite
Similar vacancies
Mastercard
... looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing ...
India, Pune
Vensure Employer Solutions
... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...
India, Thiruvananthapuram
Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. The below role is for our ...
India, Bengaluru
ShrinQ Consulting Group Inc
The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day issues that our business faces, which can be better ...
India, India
Publicis Sapient
20k
... and adoption of emerging technologies including GenAI-enabled data engineering solutions. Your Skills & Experience: 8+ years of IT experience, with 5+ years in data engineering, big data, or related technologies. Proven experience leading the design and delivery of enterprise-scale data engineering solutions. Strong hands-on ...
India, Bengaluru
... reporting and product development teams 3 to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big ...
India, Bengaluru
About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...
India, Gurugram
Recruitment Room
$ 62400 p.a.
Big Data Engineer Contract · Remote Annual Compensation Equivalent: $62,400–$166,400/year Hourly Rate: $30–$80/hour About the Role This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems. You’ll apply your engineering expertise ...
India
Recruitment Room
$ 62400 p.a.
Big Data Engineer Contract · Remote Annual Compensation Equivalent: $62,400–$166,400/year Hourly Rate: $30–$80/hour About the Role This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems. You’ll apply your engineering expertise ...
India
MaimsD Technology
... https://jobeax.com/link/2luqtWY4b55DMQvB Skills and Qualifications :- Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.- Advanced proficiency in Python for data processing, automation, and integration.- Deep understanding of relational and NoSQL databases, including ...
India
... light leading travelers to their destinations since time began, our values guide us. They help us be at our best. For the cities and communities we serve. As a Lead Data Engineer at Arrive, you are a technical cornerstone of our new Bengaluru data hub and a founding member of the team. You don't just build models - you architect ...
India, Bengaluru
Two Circles
... data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence. We are seeking a Lead Data Engineer to join our Measurement team within ...
India, Hyderabad
Novo Nordisk
... privacy, ethics and compliance requirements and embed them in day-to-day governance practice. Who you’ll work with You will join the Data and AI Foundation and lead the Data Engineering Enablement team within Novo Nordisk Enterprise IT. The team brings together AI, data and software engineers, business analysts, data architects ...
India, Bengaluru
Prudent Technologies and Consulting, Inc.
... Experience with data quality tooling (SODA, Collibra, or similar) Exposure to cloud platforms (Azure, AWS, or GCP) Experience in a regulated or enterprise-scale data environment Prior experience mentoring or leading a small pod of engineers EXPERIENCE - 8+ years in data engineering, with at least 4+ years focused on Snowflake ...
India, Hyderabad
... Azure Data Factory, Azure Data Lake, Microsoft Fabric, Logic Apps,Power BI, GitHub, and Data Modeling. Required Skills: - 10+ years of Software Engineering / Data Engineering experience. - Strong SQL Server and T-SQL expertise. - Strong experience working in the Azure environment. - Hands-on experience with Azure Data Factory. ...
India, Bengaluru
... to reinvent the food industry and remain the leading food company in the region. It also operates its Customer Experience Center in Amman, Jordan, and its Engineering Hub in Krakow, Poland. We're looking for a Senior Data Engineer to design, build, and scale the pipelines that power our analytics and AI platforms. You ...
India, Bengaluru
Kanerika Inc
... production issues, work with Databricks to open incident tickets/case and follow up to close the issue and ensure long term fixes - Additional knowledge of other Databricks key features, like Genie, Apps, Models creations etc Required Qualifications: - Bachelor's degree in computer science, Information Technology, Engineering, ...
India, Rāniganj
BAJAJ FINSERV HEALTH
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
India, Pune
... KANINI’s award-winning Data Engineering Team, recognized as the "Outstanding Data Engineering Team" at DES 2025 Work on real-world problemsat the intersection of data, AI, and product development Be part of a collaborative, innovative, and growth-driven environment. Access to cutting-edge tools, leadership support, and continuous ...
India, Mannady