Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
... Bachelor's degree in Computer Science, Data Science, Statistics, or a related field. - 8-15 years of experience in data analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. - Strong SQL skills for data querying and manipulation. - Experience with data visualization tools like Tableau or Power ...
... pipelines with automated data quality checks to support business needs and demonstrate ownership of live data pipelines. Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance. Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging ...
... Qualifications - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - 2 to 3 years of hands-on professional experience in data engineering or ETL development. - Strong proficiency in writing and tuning SQL queries across relational databases (e.g., PostgreSQL, MySQL, SQL Server). - Hands-on ...
... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...
... field (or equivalent practical experience) with 5+ years of industry experience C++ Proficiency: Strong proficiency in modern C++, backed by solid software engineering fundamentals (data structures, algorithms, object-oriented design, and modular architecture) Systems & Infrastructure: Experience designing systems software, ...
About the Role :We are looking for a skilled C++ Software Engineer to join our engineering team and contribute to the development and enhancement of Windows-based software https://jobeax.com/link/uTkIfl1tAHKRWQPa role involves designing and implementing reliable software components, debugging application issues, and working ...
... rather than developing new algorithms.- Translate business goals into AI-powered solutions, ensuring technical feasibility through collaboration with squad leads, data scientists, architects, and full stack engineers.- Integrate Google Cloud AI services and models into microservices and workflows to support scalable and maintainable ...
... engineering teams. What we are building now. We are standing at the precipice of the GenAI revolution, but the biggest bottleneck isn't the models, it's the data. you are stepping into the critical layer of the modern data stack that powers the AI economy. We are the Data Fabric that enables industry titans like LinkedIn, ...
... role Ethos is seeking a Data Engineer to join our Data Platform team and build the internal infrastructure, services, and tooling that the rest of the company's data stack runs on. This is a software engineering role with a deep data background. You will design and operate distributed workflow systems on Temporal and Airflow, ...
... & Data Platform. You’ll design and maintain reliable, secure, and scalable data pipelines and models that power a new generation of reporting, insights, and data-driven products across the StarRez ecosystem. This role sits at the intersection of data, product, and engineering. You will work closely with Data Analysts, ...
Data Engineering at Blackbaud is responsible for ingestion, transformation and processing of data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed ...
... Experience with data quality tooling (SODA, Collibra, or similar) Exposure to cloud platforms (Azure, AWS, or GCP) Experience in a regulated or enterprise-scale data environment Prior experience mentoring or leading a small pod of engineers EXPERIENCE - 8+ years in data engineering, with at least 4+ years focused on Snowflake ...
... experience with data visualization techniques and can communicate the insights as per the audience. You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems. You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). ...
... platforms. The role requires strong hands-on experience across SQL Server, Azure Data Factory, Azure Data Lake, Microsoft Fabric, Logic Apps,Power BI, GitHub, and Data Modeling. Required Skills: - 10+ years of Software Engineering / Data Engineering experience. - Strong SQL Server and T-SQL expertise. - Strong experience working ...
... checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience - Proven production data engineering experience at scale - Strong Python and SQL skills - Deep analytical warehouse ...
... Computer Science, Information Technology, Engineering, or related field. - 8+ years of experience in Devops and 3+ years in DBX. - Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow). - Proficiency in SQL and programming languages like Python or Scala. - Experience with Azure cloud data services. ...
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
... Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering ...
... processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; working knowledge of NoSQL databases like MongoDB or Firestore. Version Control & DevOps: Experience with Git, CI/CD ...