Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...
... documentation carrying the quality bar between reviews. Stack: Python, PostgreSQL, Django, server-rendered frontend (htmx). What You Will Own Core Responsibilities / Engineering Focus Deep third-party data ingestion Build reliable ingestion pipelines for external data sources Account for silently dropped webhooks through reconciliation ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 ...
... computing equipment Protects operations by keeping information confidential. Develops software solutions by studying information needs; studying systems flow, data usage, and work processes; following the software development lifecycle. Proven work experience as a Software Engineer or Software Developer Experience designing ...
... experience. Use trace analysis, source code, logs, and debugging tools to analyze problems and develop appropriate solutions; may involve writing code. Work with databases such as SQL Server to design schemas, write queries, and optimize database interactions. Write unit tests to ensure reliability and correctness of code using ...
... system design, algorithms, scalability, reliability, and operational excellence- Excellent communication, collaboration, and mentoring capabilities within Agile engineering environmentsEducation :- Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline, or equivalent professional experienceResponsibilities ...
... an impact at the company pioneering security transformation in the AI era? Join us at Zscaler. Role We are looking for a Senior Staff Software Development Engineer to join our team. This is a Hybrid role based in Bangalore, reporting to the Senior Manager, ZIA Core Engineering. You will make ZIA software run in public ...
... Git). Experience in building large-scale distributed systems or backend services. Familiarity with cloud platforms (AWS, GCP, or Azure). Good understanding of databases (SQL and NoSQL). Strong debugging, troubleshooting, and performance tuning skills. Excellent communication and teamwork abilities. This job was posted by ...
... Technical Skills: Strong hands-on frontend development using JavaScript and LWC Expertise in backend development using Apex, Flows, Async Apex Understanding of Database concepts: SOQL, SOSL and SQL Hands-on experience in API integration using SOAP, REST API, graphql Experience with ETL tools , Data migration, and Data governance ...
... Science , Engineering, or a related field (or equivalent experience). - 12+ years of experience in software development with a strong focus on .net core, C#, mssql , react, LLMs, ES - Strong understanding of RESTful APIs, microservices architecture, and cloud technologies (e.g., Azure, AWS). - Experience with database technologies, ...
... in:- Data Operations- Production Data Engineering- Data Platform Support- Data Pipeline Monitoring & Troubleshooting- Not looking for purely development-focused Data Engineers or DevOps/SRE https://jobeax.com/link/V6ZwWogXLIs5s3d8 Stack:Snowflake, dbt, Apache Airflow, Fivetran, Cloud Storage, SQL, Python, Bash, CI/CD, Git, ...
... in:- Data Operations- Production Data Engineering- Data Platform Support- Data Pipeline Monitoring & Troubleshooting- Not looking for purely development-focused Data Engineers or DevOps/SRE https://jobeax.com/link/V6ZwWogXLIs5s3d8 Stack:Snowflake, dbt, Apache Airflow, Fivetran, Cloud Storage, SQL, Python, Bash, CI/CD, Git, ...
... and results-driven Data Engineer to join our growing Data Engineering team. You will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making for our clients. This role is ideal for someone who thrives in a consulting environment, enjoys solving complex data challenges, ...
... in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms. ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... Services, WPF, https://jobeax.com/link/NY9VLwPeZTLjA7wT, Entity Framework, Dapper Web Technologies: REST API, SOAP Services, ASPX, HTML, CSS, JavaScript, JSON, XML Databases: Microsoft SQL Server, PostgreSQL Net otherwise, should be very strong in .NET. Net AWS Cloud Services: AWS EC2, ECS, S3, RDS, Lambda, API Gateway, CloudWatch, ...
... like Terraform & Ansible to reduce manual efforts and increase https://jobeax.com/link/3T8us57ZNOTZBEWN : - Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- Minimum of 5+ years of proven experience as a DevOps Engineer or in a similar capacity.- Strong understanding of Infrastructure as ...
... Responsibilities:- Design, develop, and maintain scalable enterprise applications and REST APIs using C# and .NET.- Develop efficient and optimized solutions using strong Data Structures & Algorithms concepts.- Design and implement robust database structures, queries, and stored procedures using SQL.- Perform SQL query optimization ...
HIRING | SOFTWARE DEVELOPER (C++) Location: Hyderabad Experience: 6+ Years Budget: Up to ₹20 LPA Role: Software Developer – C++ Interview: Walk-In | Client Interview – Hyderabad Notice Period: Immediate to 20 Days ONLY About the Role We are looking for an experienced Software Developer with strong expertise in C++,