Vacancy description
PKO BP
India, Pune
Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
Implements and maintains reliable and scalable data infrastructure to move, process and serve data.
Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse).
Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability)
Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
What you will need to be successful (experience and qualifications)
Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#)
Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability
Experience implementing large-scale distributed systems in collaboration with more senior team members
Knowledge and hands-on experience in technologies across all data lifecycle stages
BS degree in computer science or related field or equivalent knowledge and experience
No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner!
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Similar vacancies
Norwin Technologies
... Azure . Ensure data quality, governance, reliability, monitoring, and compliance. Partner with Data Scientists, Fraud Analysts, and Engineering teams to deliver data-driven solutions. 4+ years of experience in Data Engineering or Big Data Engineering. - 2+ years of experience building large-scale distributed data processing ...
India, Bengaluru
ganit inc.
... governance. Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other ...
India, Bengaluru
Capco Technologies Pvt Ltd
... in Computer Science, Information Technology, Engineering, or a related field.- 5 - 8 years of hands-on experience with strong programming skills in Python for data manipulation and processing.- Proficiency in SQL for querying and data transformation.- Hands-on experience or significant project work with Google Cloud Platform ...
India, Bengaluru
... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
India, Bengaluru
Valuelabs
... solutions. Ensure data quality, performance, reliability, and scalability. Required Skills: - 7+ years of Data Engineering experience. - Strong experience in Data Modeling, Data Warehousing, and ETL development. - Proficiency in Python, Java, Scala, or NodeJS. - 3+ years of SQL experience. - Experience building and operating ...
India, Rāniganj
... business stakeholders to define data requirements, ensuring that the data warehouse architecture aligns with long-term strategic business objectives.- Mentor junior data engineers and establish best practices for SQL development, code reviews, and version control to maintain high engineering standards across the https://jobeax.com/link/9XbfiWZXvAUTHpWi ...
India, Chennai
Flexiple
... automating data processes and enhancing data quality Implement monitoring and alerting systems to ensure smooth data operations Bachelor's or Master's degree in Engineering, Mathematics, Statistics, or a related quantitative field - 2–4 years of analytics, data science, or related experience - Proficiency (2–4 years) in SQL, ...
India, India
Allegis Global Solutions
... while designing and executing strategies that align workforce capabilities with the agility required to stay ahead of what's next. We are currently hiring for Data Engineer | Digital Analytics expert for global healthcare and health insurance domain. based healthcare provider and health insurance organization delivering ...
India, Pune
Diligent Corporation
700k
... or CI/CD practices. - Working knowledge of software design principles, testing, debugging, performance optimization, and secure development. - Experience with SQL databases and Git-based development workflows. - Practical understanding of AI or LLM concepts, such as generative AI, embeddings, context limits, hallucinations, ...
India, Bengaluru
Weekday AI
... for an experienced Data Engineer to design, develop, and maintain scalable data platforms and pipelines using AWS, Apache Spark, Python, SQL, Kafka, and modern data engineering frameworks . The role will focus on building reliable data solutions for high-volume batch and real-time workloads, including data ingestion, transformation, ...
India, Mumbai
... business stakeholders to define data requirements, ensuring that the data warehouse architecture aligns with long-term strategic business objectives.- Mentor junior data engineers and establish best practices for SQL development, code reviews, and version control to maintain high engineering standards across the https://jobeax.com/link/9XbfiWZXvAUTHpWi ...
India, Pune
... build robust data pipelines, data lakes, and marts to support business analysts and data scientists. Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines ...
India, Pune
Allianz Services
... directory tables, curated data models Experience integrating complex data sources: Oracle DB, SQL Server, Azure SQL DB, file systems, Salesforce, APIs Strong data modelling skills: relational, dimensional, and lakehouse-oriented DevOps & Automation CI/CD pipelines for data engineering (Azure DevOps / GitHub Actions) Infrastructure ...
India
wowJobs
About the Role:We are looking for an experienced AWS Data Engineer with 6 - 8 years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions on AWS. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS data services, with experience building robust ...
India, Pune
KPI PARTNERS INDIA PRIVATE LIMITED
... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...
India, Bengaluru
... independently and collaboratively to solve complex data challenges and drive continuous improvements across our data engineering practices. 4+ years of data engineering experience, building and managing large-scale data pipelines - Strong proficiency in Python, PySpark, Spark, Databricks, Delta Lake, PowerBI and SQL, with ...
India, Delhi
Teamware Solutions
... BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) ...
India, Bengaluru
IMerit Technology
... improve platform performance and resilience. Integrate with customer data platforms and pipelines, including bespoke data frameworks. 4–8 years of experience in data engineering or backend development in data-intensive environments. Proficient in Python and SQL; Strong experience with cloud-native data tools and services (S3, ...
India, Bengaluru
... experience designing and building scalable distributed data pipelines and dimensional data models - 3+ years of experience in Python and SQL - Experience using Databricks platform and PySpark is a must. - Extensive experience of Microsoft Azure data services – Data Factory, ADLS gen2, Event Hubs, Azure SQL, Azure Key Vault ...
India, Chennai
We're looking for a Data Center Engineer to join our Infrastructure Engineering team in Mumbai. In this role, you'll help build, maintain, and scale the critical infrastructure that powers our trading operations across APAC. Working alongside experienced engineers and traders, you'll solve complex technical challenges in ...
India, Mumbai