Senior Data Engineer - AI & Data in Bengaluru, India - Jobeax
Vacancy description
Senior Data Engineer - AI & Data in Bengaluru, India
Commonwealth Bank
India, Bengaluru
Senior Data Engineer - AI & Data in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organization, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Job Title: Senior Data Engineer You will play a pivotal role in driving business outcomes through effective data management and analysis. Enhancing Decision Making with Data Ensuring Data Security and Compliance Future Trends in Data Engineering
Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage. Collaborate with stakeholders to analyze and translate requirements to technical implementation. Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers. Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice. Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load. Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lake houses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks. 8+ years of experience in Data Engineering within large-scale, data-intensive environments.
Proficiency in building large/complex data pipelines and hands on GenAI models.
Strong expertise in Data Warehousing concepts and implementation, with hands-on experience in Hadoop technologies (Spark, Scala) and migration initiatives to AWS Cloud .
Proficiency in AWS services including EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DynamoDB, and CloudWatch .
Advanced SQL skills with proven experience in writing efficient queries, database management, performance tuning, and handling complex data transformations.
Strong experience in designing and managing data orchestration workflows using Apache Airflow .
Solid understanding of streaming data processing and event-driven architectures .
Experience in CI/CD pipeline development , automation, and deployment of production-grade code.
Deep understanding of Data Modelling, Data Warehousing, ETL/ELT processes, and Slowly Changing Dimensions (SCD) concepts .
Hands-on experience with GitHub or other version control platforms.
Proven expertise in developing and optimizing data pipelines across diverse data formats and sources.
Strong working knowledge of Linux/Unix environments for development, testing, and troubleshooting.
Relevant AWS certifications such as AWS Certified Data Engineer , AWS Certified Data Analytics - Specialty , AWS Certified Developer , or AWS Certified Solutions Architect are highly desirable.
Hands-on experience with data modelling tools such as Erwin , with the ability to design and develop data models, data warehouses, data assets, and data products.
Practical experience with AI tools, technologies, and automation solutions , with demonstrated success in driving business value and efficiency improvements through AI-enabled capabilities.
Snowflake knowledge and implementation experience will be considered an added advantage.
Bachelor's degree in engineering in Computer Science/Information Technology
... chain, logistics, IT). - Communicate technical concepts to non-technical stakeholders. - Experience with machine learning algorithms & concepts - Knowledge of data governance and compliance. - Bachelor's degree in Computer Science, Informa1on Technology, or related field. - 8+ years of experience in data engineering. - Proficiency ...
... Extensive experience in building, consuming, and optimizing RESTful APIs, with proficiency in tools like Swagger, Postman, or similar. - Strong knowledge of SQL databases and querying languages - Demonstrated experience in building and maintaining robust CI/CD pipelines using tools such as Jenkins or GitLab CI. - Exceptional ...
... the Fortune 50, achieve discoveries, insights, and business outcomes faster and more sustainably. We're passionate about solving our customers' most complex data challenges to accelerate intelligent innovation and business value. As a Senior/Staff Kernel Engineer at Weka, your primary responsibility will be collaborating ...
We are currently hiring for a Senior GenAI / Agentic AI Engineer opportunity with a leading organization.Position: Senior GenAI / Agentic AI EngineerExperience: 8+ Years overall (2+ Years relevant GenAI experience)Locations: Bangalore | Gurugram | Mumbai (Hybrid)Notice Period: Immediate Joiner preferredKey Requirements:- ...
... Develop and maintain robust Python-based ML and data infrastructure. - Implement monitoring, observability, and operational practices to ensure ML systems remain reliable and performant. - Apply software engineering best practices, including automated testing, documentation, version control, and system design. - Provide ...
... solutions for faster time to market. AI Engineer is proficient in leveraging available AI tools in applying real world use cases for better productivity. As a Senior AI Engineer, you bring strong hands-on experience with Python, prompt engineering, generative AI technologies, and the successful delivery of AI-powered solutions ...
... defining data contracts, quality gates, service levels, and access models.- Stakeholder management : Track record working across business leaders, product owners, data/AI engineers, security, and platform teams.- Ability to operate at senior level, challenge incomplete requirements, make trade-offs transparent, and drive decisions ...
... comfortable using LLMs/AI copilots as part of daily workflow (analysis, documentation, communication, process design), not just as a novelty. - Experience working with AI/ML teams and understanding of how annotated data feeds into model training. - Strong understanding of quality frameworks (QA/QC) for spatial data and annotation ...
... assistants)- Ensure responsible AI practices including model governance and explainability- Establish data governance framework (catalog, lineage, ownership)- Ensure data quality, consistency, and compliance- Work closely with business leaders to translate requirements into data solutions- Lead cross-functional teams (data engineers, ...
... and backend engineering, test-driven development, microservices and architecture design principles - Must have experience on AI/ML implementation such as: Langchain, Langgraph and ML models such as Gradient Boost, Random Forest etc. - AI & LLM Frameworks: Experience with foundational models and APIs (e.g. OpenAI, Claude, ...
Senior Data Engineer – Graph Database & Data Intelligence Position: Senior Data Engineer Experience Required: 6+ Years Location: Remote Employment Type: Contract We are seeking a highly skilled Senior Data Engineer with expertise in Graph Databases, Data Modeling, and modern backend frameworks. The ideal candidate should ...
Data Engineer – Python & Pyspark (AWS) Exp: 6+ yrs Location : Chennai Client Place Guindy Work Mode : All 5 days Role Overview We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You ...
... during your interview. Position Title – Senior Data Engineer The Senior Data Engineer will lead the design, development, and optimization of enterprise-scale data pipelines and integration solutions. This role requires deep expertise in data engineering principles, strong knowledge of relational databases, and experience ...
... large volumes of data, create meaningful analyses, and deliver recommendations to https://jobeax.com/link/R1rBsus5T71Cfgto Responsibilities :- Create and maintain optimal data pipeline architecture ETL/ ELT into structured data.- Assemble large, complex data sets that meet business requirements and create and maintain multi-dimensional ...
Position: Senior Data Engineer Location: Pune Job Responsibilities Design, develop, and maintain scalable data pipelines using AWS services. Design and implement scalable, secure, and resilient MLOps architecture across cloud and on-prem environments Define best practices for model lifecycle management, including versioning, ...
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate ...
Hiring : Senior Data Engineer | 6+ https://jobeax.com/link/elpmNuUlUrtRmNOJ : https://jobeax.com/link/TEtw0SgP3UR1RgAh : Senior Data https://jobeax.com/link/gTHUyXDKJ42uWexF are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, ...
... in London with Offices in New York, London and Chennai. Our team of over 450 people is a unique blend of individuals with skills across commercial consulting, data science and software engineering. In May 2023 we took a minority investment from Baird Capital and in January 2024 we opened an office in New York with the ambition ...
... - Share knowledge and best practices with Team ***** - Mentor junior data engineers on PySpark and Databricks technologies - Document technical solutions and maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline ...
... business stakeholders. AI / GenAI Experience Hands-on experience using AI/GenAI tools as part of development or data engineering work. Understanding of how LLMs and AI services can be integrated with data platforms and applications. Experience with Amazon Bedrock, SageMaker, AI APIs, RAG, vector databases, or similar technologies ...