Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
... and .NET Core/Web API. Strong expertise in SQL Server development, including T-SQL, stored procedures, functions, and triggers. Hands-on experience with SSIS (SQL Server Integration Services) for data integration and ETL processes. Experience designing, developing, and deploying SSRS (SQL Server Reporting Services) reports ...
... global projects. - Degree in Engineering, Computer Science, Information Technology, Data Science, or a related discipline. Formal training or certification in Data provisioning will be preferred. Experience: · 5+ years of rich experience with Data provisioning within Supply Chain . (prior experience collaborating with global ...
Role :Lead Engineer - Conversion/Migration Skills - Mandatory-SQL Server, ETL/Data Migration Skills - Good to have -SSIS, Azure Data Factory Work location: Kochi/Trivandrum Total Experience: 6-9 years Strong hands-on expertise in SQL Server (T-SQL) and relational database design, with solid experience in data migration ...
... aligned with business needs. Collaborate with stakeholders to understand requirements and translate them into working software. Ensure adherence to software engineering best practices including OOAD, SOLID principles, testing, and automation. Maintain high standards of code quality, performance, scalability, and security. ...
... secure, performant data flows.- Design, implement, and maintain RESTful APIs using C#/.NET Core.- Integrate UI and back-end services, ensuring secure, performant data flows.- Model and optimize schemas in PostgreSQL, MongoDB, or SQL Server.- Apply automated testing, CI/CD pipelines, and containerization (Docker) to ensure code ...
... definitions and Data Quality Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python ...
... design and implement automated data pipelines and materialized views. - Proficiency in Python, Unix or similar languages. - Good understanding of SQL oracle, SQL server or similar languages. - Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions). - Core Engineering: Data structures/algorithms, ...
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
... Shishir's team, Data analytics CoE head. Someone that can help with the reporting needs, need resource who can support here. Require more data visualization, know data engineering as well. -SQL Tableau -SQL - Need to create data for powerBI and tableua, done in SQL - BCG Data Lake is entirely snowflake - Write SQL queries in ...
... integrate data solutions into the overall architecture. Previous experience in Data Engineering, we're looking for around 3-7 years worth of experience. Strong SQL skills and experience working with relational databases such as Snowflake, PostgreSQL, or MySQL. Experience building and maintaining data pipelines and ETL workflows ...
... modelers and analysts to deliver analytics-ready datasets Support downstream reporting and dashboarding use cases What we’re looking for Strong experience as a Data Engineer in Azure environments Hands-on with tools such as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience ...
... cost-aware query design. Advanced SQL skills, including window functions, recursive CTEs, complex joins, MERGE patterns, and query performance tuning against large datasets. Strong Python development experience for data engineering — building ingestion jobs, transformation logic, reusable libraries, and automation scripts. Experience ...
... production-ready Tableau dashboards. ~ Data Querying (Mandatory): Expert-level command of SQL for data extraction and manipulation. - Proven experience working with data in the Fintech, Banking, or Financial Services sectors. - Soft Skills: Proven ability to engage with non-technical business leaders to understand their data needs ...
... capture the most granular data. Align the engineering and product teams on the Data Granularity and accuracy requirements. Build Alerts to detect bugs in the data pipeline. Perform data analysis to test hypothesis and uncover factor influencing metric variations Build Feature Store for Data Science implementations Overall ...
... product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage with Engineering & Product when needed. Partner with Account Managers, ...
... dashboards. - Expert-level proficiency in SQL , including complex queries, joins, aggregations, subqueries, and data manipulation. - Strong understanding of data preparation, data modelling, reporting, and visualisation principles. - Experience working with financial, operational, risk, or business performance data. - ...
... demonstrate technical and non-technical information, ideas, procedures, and processes Prior experience in an SAP and/or Informatica driven environment Ability to use SQL to analyze data Bachelor's degree related to Information Systems, Business or other relevant academic discipline with a minimum 4 years job experience in IT or ...
... consumption. - Familiarity with Microsoft Fabric, Power BI semantic models, and enterprise data architectures. Database Expertise Strong SQL Server and Azure SQL development experience. Ability to write and optimize complex SQL for transactional and reporting use cases. Experience designing scalable database structures ...
... in: C# https://jobeax.com/link/GrYTXLZMpxEMJknV https://jobeax.com/link/NY9VLwPeZTLjA7wT https://jobeax.com/link/GrYTXLZMpxEMJknV MVC Web API Entity Framework Database Technologies MySQL SQL Server Database Design, Optimization, and Performance Tuning Application Development Web Application Development API Development & ...
... and resolved instantly. com, QuickFixCars, https://jobeax.com/link/MzS4zazpv1veUNOU policybazaar.Experience- 2-6 years Net, dot net core, Web API, C#, Web API, SQL Server, JQuery Skill for writing reusable libraries Strong Object Oriented design and analysis skills, specifically in the use of design patterns Strong understanding ...