Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Hello, We are hiring for 'Data Engineer with Java' for Pune Location. Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline CI/CD SQL NOTE: We are looking for Immediate joiners(notice period ...
... analysis to validate source data, understand distributions, and surface data anomalies during scoping and build phases. Work with stakeholders to define and monitor data SLAs, ensuring data products are trustworthy and consistently delivered. What You Bring - 4–6 years of experience in data engineering, analytics engineering, ...
... MAKE AN IMPACT Job Title: Data Engineer _DEPS Experience: 3–5 Years Location: Bangalore and Pune (Hybrid – Client Office) Job Summary: Seeking a skilled Senior Data DevOps Engineer having experience in Cloudera platforms, data engineering, and DevOps automation. The ideal candidate will manage and optimize Cloudera environments, ...
... Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration Python PySpark Strong SQL and data engineering fundamentals hands-on experience in GCP-based data platforms.
... technical authority on internal data contracts and API schemas in cross-functional discussions with backend, product, and AI/ML teams 5+ years of experience in data engineering, with a proven track record delivering production-grade pipelines, data models, and storage architectures - Deep SQL expertise; hands-on experience ...
... Costco Wholesale. Data Engineer The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner ...
... write-back and the ledger reconciliation). Large-scale data / ETL engineering; SQL Server; performance tuning, Graph / vector stores, record linkage; graph and vector databases; SQL Server (incl. large-scale data engineering Nice-to-have. Experience in Legal or party data at scale. Experience. Data migration experience, Min 2 years ...
... Analytical reasoning- You can take a messy problem, break it down, and determine what needs to be understood. Data fluency- You are comfortable working directly with data and can independently investigate a problem using tools such as Excel/Sheets, SQL, BI tools, or equivalent. You do not need to be a data engineer. You do need ...
... Independently code, debug, test, and troubleshoot applications.- Collaborate with QA teams and leverage relevant QA/testing tools to ensure product quality.- Work with SQL/MySQL and relational databases for application development and troubleshooting.- Participate in Agile development processes, sprint planning, reviews, and retrospectives.- ...
... design and implement engineering solutions that align with organizational goals and technical requirements. - Overseeing the development and validation of engineering models and simulations to ensure they meet accuracy and performance standards. - Providing expert recommendations based on data analysis to optimize engineering ...
... work Bachelor's degree or higher in Computer Science, Data Engineering, or a related field (or equivalent professional experience) - 3+ years of experience in data engineering, analytics engineering, or a similar data-focused role - Strong SQL skills, including schema design for data warehouse or data lake use cases - Proficiency ...
... our important systems and services throughout the company. As an experienced and passionate member of an agile capability team you will deploy leading edge engineering and product configuration solutions that deliver value to our customers. The team uses .NET, C#, JavaScript, SQL, HTML/CSS, RESTful web services and Azure ...
... Dinex? We are seeking a talented individual who is proficient in Java, SQL, machine learning, Hadoop, Python, data analysis, data entry, data cleaning, and data engineering to join our team. Key Responsibilities: 1. Utilize your expertise in Java, SQL, and Python to develop and maintain data pipelines for efficient data processing. ...
... Mumbai/ Hyderabad/ Pune/ Gurgaon Job Role: We are mainly looking for quant developers with agile/scrum project management experience with strong Python as well as SQL and KDB. Databricks a plus, Fabric a plus, PySpark/Tensorflow a plus, C/C++ a plus. Any other data management tools a plus ie Arctic/Mongo/Dashboarding. Hedge ...
... rely on you to drive. Who You Are Must-Have - 25 years building production data pipelines: real systems with real consumers, not just one-off scripts - Strong data engineering fundamentals : data modeling, batch vs. streaming, idempotency, incremental processing, partitioning. - Expert SQL and strong Python : query optimization, ...
... Core . Expertise in Windows Presentation Foundation (WPF) and XAML . Strong understanding of MVVM architecture . Experience with Entity Framework , LINQ, and data access technologies. Knowledge of REST APIs , Web Services, and integration patterns. Experience with SQL Server and database development. Familiarity with source ...
HIRING | SENIOR EMBEDDED C++ DEVELOPER Location: Hyderabad Experience: 5+ Years Budget: Up to ₹18 LPA Role: Senior Embedded C++ Developer Interview: Walk-In | Client Interview – Hyderabad Notice Period: Immediate to 20 Days ONLY About the Role We are looking for a Senior Embedded C++ Developer with strong expertise in
... implementation and REST Services experience Knowledge of XML, XSLT, JSON, REST services and web services Experience with Microsoft SQL Server and other relational databases Experience with Agile development methodologies is preferred Proficiency in programming languages such as C# and .NET Understanding of SQL Server and database ...
... applications using Spring Core, Spring MVC, Spring Boot, and related technologies; proven experience with Kafka, GraphQL, web services, and both relational and NoSQL databases (Cassandra). - 5+ Hands-on experience in cloud-native application development, including migration, modernization, and optimization for AWS and Azure ...