Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
... to work for its clients in order to build a positive future for all. Minimum of 4-6 years of experience in software development, with a strong focus on: .NET SQL React. PHP NET (C#, https://jobeax.com/link/GrYTXLZMpxEMJknV Core, MVC, Web API). Strong experience with SQL (T-SQL, database design, and optimization). Good ...
Job Description :We are seeking a highly skilled Computer Vision Engineer to join our team and work on cutting-edge projects involving computer vision algorithms on edge devices. The ideal candidate will have experience in developing computer vision applications on edge devices such as embedded systems, IoT devices, mobile ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
... with holistic service to streamline, simplify and expedite the immigration process for employers and individuals. We are looking for a passionate Software Engineer to join our dynamic feature team in Hyderabad, India. As our Software Engineer, you will be required to: Contribute to tech grooming backlog items providing ...
... Code coverage analysis and reporting What We Need To See Bachelors Degree (or equivalent experience) in a relevant discipline (Computer Science, Electrical Engineering or Computer Engineering) with 2+ years of relevant work experience. Strong programming ability: C++, C along with a good understanding of build systems (CMAKE, ...
... Millennium's Information Technology organization, which is core to the health and growth of the firm. It builds, manages, and maintains applications and fundamental data that support Portfolio Management groups in managing risk and PnL. The team develops and supports next-generation in-house risk and analytics tools across risk, ...
... closely with Firmware Engineers, Hardware Engineers, Validation/QA, and System/Storage Architects.- Collaborate with Product Management and cross-functional engineering teams.- Coordinate with teams involved in HDD/SSD, storage controllers, embedded systems, and performance engineering.- Provide technical guidance to junior ...
... data engineering solutions aligned to enterprise standards Build and optimize batch and streaming data pipelines using AWS native and opensource tools Develop SQLdriven transformations and Pythonbased data pipelines for analytics use cases Design efficient data models for performance, scalability, and cost effectiveness ...
Job Title: Data Engineer - ML Training Data Pipeline Notice period: 0-30 Days Experience : 5+ Years Location: Hyderabad OR Pune  We are looking for  Data Engineer - ML Training Data Pipeline who can  Build and maintain the data pipeline that transforms raw production traces into high-quality training datasets ...
... skills and grounding in programming and SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes, ETL tools. The Data Engineer Lead will work closely with customer Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines. Data engineer ...
... specialized knowledge within the Commercial data domain. What Should you have: - BS Computer Science or related field with 3 – 5 years of working experience with Data Engineering. - Core Languages: Proficient in SQL and Python for data manipulation, ETL pipeline building, and debugging. - ETL with IDMC: Practical experience ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. AWS AI Services Minimum 3 Year(s) ...
... Experience with system integration, implementation, upgrades, migrations, or technology modernization. - Good understanding of application, infrastructure, cloud, database, networking, or platform technologies relevant to the role. - Familiarity with automation, monitoring, DevOps, CI/CD, cloud platforms, or modern engineering ...
... members of IT, including business analysts, database administrators, and managers, to design and develop Cognos reporting capability- Exhibit a commitment to data quality by validating results against sources specified in the requirements- Develop and maintain stored procedures- Write and support queries against databases ...
... in data security and privacy engineering, this individual deploys and tunes data discovery, classification, DLP, encryption, and key management controls. The Data Protection Engineer partners closely with Engineering, IT, Compliance, Legal, and Privacy stakeholders to embed privacy-by-design principles into how data is ...
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...