Senior Software Engineer II - Data Engineering and… - Jobeax
Vacancy description
Senior Software Engineer II - Data Engineering and Platform in Bengaluru, India
lgads
India, Bengaluru
Senior Software Engineer II - Data Engineering and Platform in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
LG Ad Solutions
LG Ad Solutions is a global leader in connected TV (CTV) and cross-screen advertising. We pride ourselves on delivering state-of-the-art advertising solutions that integrate seamlessly with today's ever-evolving digital media landscape.
The Opportunity:
We are seeking a highly skilled and experienced developer to join our team in the role of Senior Software Engineer II – Data Engineering & Platform. This pivotal role focuses on providing technical vision and leadership for a major business component, managing end-to-end processes that operate at a high scale, processing several petabytes of data daily. The ideal candidate will have a robust background in data engineering, coupled with a proven track record in technical leadership. You will collaborate with cross-functional teams to drive technical innovation and deliver robust, scalable solutions that meet our business needs.
Responsibilities:
Architect and Implement Scalable Data Solutions: Design, develop, and deploy comprehensive data solutions encompassing ETL pipelines, data warehousing, data architecture, data cataloguing, and data delivery mechanisms. Ensure these solutions are scalable, reliable, and maintainable to support evolving business needs.
Lead Data Platform Strategy: Develop and execute the strategic vision for the data platform, ensuring alignment with organizational objectives. Oversee the architecture and management of data systems to support efficient data storage, processing, and utilization.
Collaborate Cross-Functionally: Work closely with product managers, engineering teams, data scientists, and other stakeholders to design and implement effective data integration and hand-off mechanisms. Facilitate seamless data flow and accessibility across various systems and teams.
Optimize Performance and Scalability: Identify and address performance bottlenecks within the data platform. Implement strategies to enhance system performance, scalability, and reliability, ensuring the infrastructure can handle large-scale data processing efficiently.
Oversee Data Governance and Quality: Implement and maintain data governance frameworks to ensure data quality, accuracy, consistency, and security. Establish policies and procedures for data management, ensuring compliance with regulatory requirements and industry best practices.
Mentor and Lead Engineering Teams: Provide technical leadership and mentorship to data engineers and other team members. Foster a culture of innovation, ownership, and continuous learning within the team, guiding them through complex technical challenges and project deliveries.
Conduct Code and Architecture Reviews: Lead code and architecture reviews to maintain high standards of code quality and system design. Provide constructive feedback and ensure adherence to best practices and organizational standards.
Stay Abreast of Industry Trends: Keep up-to-date with emerging technologies, tools, and methodologies in data engineering and platform development. Evaluate and recommend new solutions to enhance the data platform's capabilities and efficiency.
Requirements:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams.
Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka.
Experience with programming languages such as Scala and Python for developing robust data pipelines.
In-depth knowledge of both relational and non-relational databases, with the ability to design and optimize complex queries.
Hands-on experience with data visualization tools and techniques to present data insights effectively.
Proficiency in developing and maintaining CI/CD pipelines using tools like Jenkins and GitHub Actions.
Experience with Infrastructure as Code (IaC) tools such as Pulumi and Terraform for managing cloud resources.
Strong experience in writing and maintaining unit, integration, and end-to-end tests to ensure data pipeline reliability and accuracy.
Excellent problem-solving abilities with a keen attention to detail, capable of diagnosing and resolving complex technical issues.
Strong communication skills, with the ability to convey complex technical concepts to diverse audiences.
Proven ability to collaborate cross-functionally with product managers, data scientists, and other engineering teams to deliver cohesive data solutions.
Familiarity with data governance and security practices to ensure compliance and data integrity.
Preferred:
Prior experience working with Databricks and AWS cloud services.
Experience with Agile development methodologies and leading Agile teams.
Experience in working with Distributed Graph Databases.
LG Ad Solutions provides equal work opportunities to all team members and applicants, and it prohibits discrimination and harassment of any type on the basis of race, color, ethnicity, caste, religion, age, sex (including pregnancy), national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by our policies or federal, state, or local laws.
We want to ensure that our hiring process is accessible. If you need reasonable accommodation for any part of the application process because of a medical condition or disability, please send an email to View email address on https://jobeax.com/link/shEg8iuZJT8mFyEI to let us know the nature of your request.
... at: Government Data, Analytics & Linking Technology|LexisNexis Risk Solutions Our collaborative, cross-functional teams tackle complex research, design, and software development projects. We value input and creativity from each team member and encourage open communication at every stage. As a Senior Software Engineer II, ...
... speed and scale. Aatmix helps organizations deliver and operate software faster and more clearly by removing complexity through disciplined, outcome-driven engineering. Intelligent software systems are built, evolved, and run through the collaboration of human engineering expertise and agentic AI designed to scale and continuously ...
... experience with enterprise platforms such as Salesforce or ServiceNow , as these skills translate well into our Enterprise-Grade Orchestration environment. #SoftwareEngineering #AIEngineering #CloudComputing #AgileDevelopment #EnterpriseSoftware Tools and Resources - Training and Development: During onboarding, we focus ...
... testing strategies for software releases. This role involves gaining insights into interfacing applications, test environments, and utilizing Testing Services tools and methodologies. The Quality Engineer II will decompose business and technical requirements into test case scenarios and acceptance tests, define test data requirements, ...
... https://jobeax.com/link/mYvMZkpRFRzMWb6X company culture revolves around maximizing decision velocity and minimizing decision risk for enterprises ambitious enough to make data their voice. Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion. Cloud Data Migration ...
We are seeking a Senior Data Engineer with 5+ years of experience in designing and building scalable data platforms, ETL pipelines, and data warehousing solutions. The ideal candidate will have strong expertise in distributed data processing, cloud technologies, and software engineering best practices. Key Responsibilities: ...
... advanced data engineering and analytics, fostering a culture of collaboration and continuous https://jobeax.com/link/yeka7e9uOhXV2ngJ the Role :We are seeking a Senior Fabric Data Engineer who can help with the design and building of data https://jobeax.com/link/jcqkTDCTdscBt8W9 :- Building Data Factory pipelines in Fabric- ...
... applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing - 2+ years of hands-on experience ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... professional services, financial services, government and technology. We are hiring our first Senior Engineer in India . This is a hands-on, end-to-end product engineering role where you will own solutions from understanding the business problem through development, deployment and production. Key Responsibilities Understand ...
... https://jobeax.com/link/J2bfhuEYcRJgU7MA, https://jobeax.com/link/GrYTXLZMpxEMJknV, Aspx, REST API, .NET Core, C# US top Auto Inspection company is Looking for: Senior Software Engineer with extensive experience in designing, developing, modernizing, and supporting enterprise applications using C#, .NET Framework, .NET Core, ...
... (MVVM etc.) - Must have diverse experience utilizing Java tools in business, Web and client-server environments including Java Platform, J2EE, JDBC technologies and Apigee gateway platform - Experience or exposure to Database Design and Implementation - Leading the technical scrum team and implementing hands-on the front ...
... high-performing Senior Software Engineer to design, scale, and optimize our mobile applications. In this role, you will own the technical architecture, cross-platform development, native modules, UI styling frameworks, and API integrations for our iOS and Android platforms. Experience in the Online Travel Agency (OTA) sector ...
Job Description Contact center platform experience is the core: NICE CXone administration and integration, plus Microsoft-stack build work including Copilot Studio, Dynamics 365 Contact Center, Azure Communication Services, Azure AI (Speech and Foundry), Microsoft Fabric, and Power BI.
... looking for a highly experienced Senior Staff / Staff Front-End Engineer to own the technical direction, architecture, and evolution of a common React-based UI platform used across multiple products and engineering https://jobeax.com/link/3IVZ3ngA7H22gp6w role will serve as the technical anchor for UI platform engineering, ...
... organization better. The Technology Data and Intelligence (TDI) team at Okta is focused on boosting internal efficiency through the implementation of secure, scalable, and innovative systems. About the Role The team is seeking a talented Senior Software Engineer (FullStack) to become part of our TDI team in Bangalore, who can effectively ...
... accelerate productivity and improve software quality through responsible AI integration. You will join the Developer Productivity team within the Platform Engineering org. Our mission is to empower our engineers to ship high-quality products with confidence and high velocity. You'll help transform the software development ...
... integration, services oriented architecture, software testability etc. Be a keen learner and enthusiastic about developing software. Experience with prompt engineering, chain-of-thought, retrieval augmented generation, vector databases and preferably llm agents. Experience with Cloud infrastructure and platforms (Azure, ...
... developing production web applications using JavaScript or TypeScript and a modern frontend framework. Understanding of software engineering fundamentals, including data structures, algorithms, software design, testing, and version control. Experience designing, debugging, and maintaining reliable and maintainable software. Demonstrated ...