Data Engineer (SQL, C#) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). Adheres to and advocates for data engineering best practices(e.g. data modeling, pipeline idempotency, operational observability) Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. What you will need to be successful (experience and qualifications) Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability Experience implementing large-scale distributed systems in collaboration with more senior team members Knowledge and hands-on experience in technologies across all data lifecycle stages BS degree in computer science or related field or equivalent knowledge and experience No prior experience in the energy industry required
Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
... https://jobeax.com/link/64MjbzVvQ54eChVk Leadership : 1. Lead and mentor a team of engineers, fostering a collaborative and high-performance culture.2. Provide technical direction and guidance on complex software engineering challenges.3. Drive code quality, best practices, and standards across the engineering team. (ref:hirist.tech)
... https://jobeax.com/link/64MjbzVvQ54eChVk Leadership : 1. Lead and mentor a team of engineers, fostering a collaborative and high-performance culture.2. Provide technical direction and guidance on complex software engineering challenges.3. Drive code quality, best practices, and standards across the engineering team. (ref:hirist.tech)
... existing software Develop documentation throughout the software development life cycle (SDLC) Serve as an expert on applications and provide technical support Database: MS SQL Server Apply knowledge of technologies, applications, methodologies, processes and tools to support the system Ability to work as a team member Ability ...
... platforms. com for more information about our mission, products, research, and services. BestEx Research’s Bangalore office is not an “offshore center.” It’s a core engineering and research hub - working on the exact same problems and projects as our U.You’ll be part of the global brain trust, solving some of the hardest problems ...
... stakeholders to gather and define technical requirements. Oversee code reviews, ensure adherence to best practices, and mentor junior team members. Design and manage SQL Server databases, including schema creation, query optimization, and stored procedures. Ensure the integration of frontend frameworks like Angular or React with ...
... and WCF/REST services.- Data Transformation : Deep mastery of XML technologies, including XSLT, XSD schemas, XPath, and flat-file disassembling/assembling.- Database Skills : Strong knowledge of Microsoft SQL Server, T-SQL, stored procedures, and BizTalk database maintenance concepts.- Integration Protocols : Solid experience ...
... KTM. Architect and develop complex document capture, classification, and extraction workflows with advanced customization via C#/.NET scripting. Integrate with SQL Server for data validation, PO/vendor matching, and export automation. Build PDF output routines and automate export to ERP systems, file shares, or email. Troubleshoot ...
... and WCF/REST services.- Data Transformation : Deep mastery of XML technologies, including XSLT, XSD schemas, XPath, and flat-file disassembling/assembling.- Database Skills : Strong knowledge of Microsoft SQL Server, T-SQL, stored procedures, and BizTalk database maintenance concepts.- Integration Protocols : Solid experience ...
... wpf for developing desktop and web applications. - Strong understanding of object-oriented programming and software development principles. - Experience with database management systems and web services. - Excellent problem-solving skills and the ability to work in a fast paced environment. - Effective communication skills ...
With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and ...
... Notification Alerts, SQL dashboards, and Genie Spaces to improve monitoring, self-service analytics, and business user adoption.- Monitor, troubleshoot, and improve data pipeline reliability and quality.- Collaborate with stakeholders to deliver business-focused data solutions.- Mentor junior engineers and promote data engineering ...
... complex environments, while being mindful of security considerations Work with Visual Studio to modify c# solutions Use TFS tasks to enforce quality (i.e. Automate database operations (SQL Server) A recommended minimum of 6 years in a DevOps role is required Bachelor's degree or equivalent work experience considered Flexible, ...
... ingestion pipelines (Azure Data Factory or Fabric Pipelines) from various sources.- Data Transformation & Modeling: Implement data transformations using Fabric Dataflows Gen2, Spark SQL, and Python.- OneLake & Data Warehouse Management: Manage storage in OneLake, build SQL analytics endpoints, and optimize data warehousing.- ...
... Competitive salary Competitive salary Experience 4 year(s) 4 year(s) Apply By Not Provided Posted 3 weeks ago Job Be an early applicant About the job Repair Design Engineer: Looking for a Repair Design Engineer, this role will be responsible for performing data mining for the Surface History project by extracting data from various ...
... initiatives. 3-5 years of professional software development experience with full-stack development exposure. - BE/BTech in Computer Science, Information Technology, Engineering, or related field. - NET/.NET Core, C#, and REST API development. - Familiarity with Microservices architecture, Kubernetes, Docker, SQL databases, and CI/CD ...
... python or https://jobeax.com/link/JSd7UYCSg572jJDY), capable front-end skills (JavaScript, https://jobeax.com/link/6WcBICn0LM558SP0, Flutter, etc) plus strong SQL/data skills Experience with cloud platforms (preferably AWS) and modern DevSecOps practices Strong testing discipline and focus on quality and operational excellence ...
Job Title: AI Application Engineer Johnson Controls International (JCI) is seeking AI Application Modernization Engineer to join our Digital Transformation team. This role is ideal for an experienced software engineer with deep expertise in legacy application modernization, AI-assisted software development, and Microsoft ...
... Hands-on experience with AI orchestration frameworks such as Semantic Kernel, LangChain, LangGraph, LlamaIndex, AutoGen, or CrewAI.- Experience with relational, NoSQL, and vector databases, including SQL Server, PostgreSQL, MongoDB, Cosmos DB, and Azure AI Search or comparable vector technologies.- Strong understanding of Azure ...
... Hands-on experience with AI orchestration frameworks such as Semantic Kernel, LangChain, LangGraph, LlamaIndex, AutoGen, or CrewAI.- Experience with relational, NoSQL, and vector databases, including SQL Server, PostgreSQL, MongoDB, Cosmos DB, and Azure AI Search or comparable vector technologies.- Strong understanding of Azure ...
... Hands-on experience with AI orchestration frameworks such as Semantic Kernel, LangChain, LangGraph, LlamaIndex, AutoGen, or CrewAI.- Experience with relational, NoSQL, and vector databases, including SQL Server, PostgreSQL, MongoDB, Cosmos DB, and Azure AI Search or comparable vector technologies.- Strong understanding of Azure ...