Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
... demanding capital markets firms, we develop the flexible tools, technology and innovation that deliver our clients a competitive edge. Our globally distributed engineering teams focus on adaptable technology and open architecture to develop highly sophisticated trading solutions that can automate and scale with your business ...
... Lead and mentor a team of engineers, fostering a collaborative and high-performance culture.- Provide technical direction and guidance on complex software engineering challenges.- Drive code quality, best practices, and standards across the engineering https://jobeax.com/link/8hhwx0Db9xb1PsdQ are we looking for :- 12 - ...
... pyramid, risk‑based testing, and shift‑left practices - Quality Governance — Ability to define coding standards, quality gates, and automation best practices - Test Data & Environment Strategy — Knowledge of synthetic data creation, stubs, mocks, and environment‑independent automation - Cross‑Functional Collaboration — Works effectively ...
Design and development of software product(s) using latest versions of C#/.Net and SQL Server and popular content services platform Writing technical design documents Strong experience in C#.NET, SQL Server/Oracle RDBS, PostgreSQ Must have worked with multi-threading and performance tuning .NET Apps Sound knowledge on Web ...
... performance issues that have been 'known' for years. Get your hands dirty with SQL Server: query performance, indexing, transactional correctness. If there are data pipeline needs (Kafka, etc.), you'll help build those too. Critical paths live in modern code. Database hot spots stop waking people up at night. Least privilege, ...
... data consumption layers Qualifications - Solid hands-on experience with SAP Datasphere, including data modeling and dataflows - Proficiency in SQL, including SQL Script for custom logic development - Strong working knowledge of SAP HANA, particularly in building and optimizing Table Functions, procedures, and data layer ...
... : - Proficient in setting up and maintaining CI/CD pipelines using Azure DevOps or similar https://jobeax.com/link/tQgzg369gfPZ4rED : - Familiarity with Azure SQL, Cosmos DB, or other databases for full stack https://jobeax.com/link/o05H3bMu7K3Zs25f Practices : - Strong understanding of software development best practices, ...
... Commercial Sales Experiences (CSX) Engineering Team! Be part of a team dedicated to innovation and at the forefront of AI-Led engineering. As a Principal Software Engineer, you will lead the end-to-end software development lifecycle, including requirement gathering, architecture, application and database design, development, testing, ...
... services are built in .NET (Controllers, Routing). SQL: Ability to write basic SQL queries (SELECT, JOIN, WHERE) and an understanding of relational database schemas (SQL Server or PostgreSQL). Tools: Experience with Visual Studio or VS Code. Analytical Thinking: Ability to trace data from the UI down to the database level. Ability ...
... towards Microsoft .NET technologies, including MVC and MVC Core. Requires good understanding of web-based Microsoft technologies. Requires good knowledge of database design, writing SQL, T-SQL scripts, and stored procedures in SQL Server. Familiar with Agile software development methodology. Adheres to best practices in ...
... business stakeholders to define data requirements, ensuring that the data warehouse architecture aligns with long-term strategic business objectives.- Mentor junior data engineers and establish best practices for SQL development, code reviews, and version control to maintain high engineering standards across the https://jobeax.com/link/9XbfiWZXvAUTHpWi ...
... Shell Scripting. Strong analytical skills for data engineering tasks. Familiarity with tools likeApache Airflowfor data migration workflows. Experience with database systems such asOracle,MySQL, orDB2. Knowledge of legacy data migration from diverse sources. Previous experience with data migration to platforms like ServiceNow. ...
... data solutions (storage, integration, processing, access) on Google Cloud Platform or a comparable cloud platform.- Strong proficiency in SQL and Python for data engineering workloads.- Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data.- Solid ...
... Azure . Ensure data quality, governance, reliability, monitoring, and compliance. Partner with Data Scientists, Fraud Analysts, and Engineering teams to deliver data-driven solutions. 4+ years of experience in Data Engineering or Big Data Engineering. - 2+ years of experience building large-scale distributed data processing ...
... governance. Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other ...
... in Computer Science, Information Technology, Engineering, or a related field.- 5 - 8 years of hands-on experience with strong programming skills in Python for data manipulation and processing.- Proficiency in SQL for querying and data transformation.- Hands-on experience or significant project work with Google Cloud Platform ...
... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
... solutions. Ensure data quality, performance, reliability, and scalability. Required Skills: - 7+ years of Data Engineering experience. - Strong experience in Data Modeling, Data Warehousing, and ETL development. - Proficiency in Python, Java, Scala, or NodeJS. - 3+ years of SQL experience. - Experience building and operating ...
... business stakeholders to define data requirements, ensuring that the data warehouse architecture aligns with long-term strategic business objectives.- Mentor junior data engineers and establish best practices for SQL development, code reviews, and version control to maintain high engineering standards across the https://jobeax.com/link/9XbfiWZXvAUTHpWi ...