Data Engineer (GCP, Azure) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.
The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner…
What you will be doing? As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.
Your responsibilities will include:
Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.
What we are looking for?
Proficiency in Python, SQL, and database management.
Experience with Data Pipelines ETL, Cloud Services ( MS Azure, GCP preferred) , ML Modeling, Spark & Kafka.
Proven problem-solving skills and a solution-oriented mindset.
Excellent communication skills to collaborate effectively within teams and with stakeholders.
Strong business acumen with an interest in business-facing roles.
Adaptability and a start-up mentality to thrive in a dynamic environment.
Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms.
Successful candidates often possess Computer Science, Electronics, and Communication Engineering degrees.
GCP Data Engineer Mandatory Skills Relevant work experience between 3 to 7 years. Proficient Experience on designing, building and operationalizing large-scale enterprise data solutions using at least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming ...
... Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration Python PySpark Strong SQL and data engineering fundamentals hands-on experience in GCP-based data platforms.
About the Role:KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our https://jobeax.com/link/OBSYxKmspgkYWOcn ...
About the Role:KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our https://jobeax.com/link/OBSYxKmspgkYWOcn ...
... Type : Full-TimeJob Summary:We are looking for an experienced Azure Data Engineer with 7+ years of expertise in designing, developing, and maintaining scalable data solutions on Microsoft Azure. The ideal candidate should have strong experience with Azure data services, ETL/ELT pipelines, cloud data warehousing, big data ...
... Technology we are looking for a proven Hyperconverged Infrastructure (HCI) Engineer to support and evolve EY's HCI platforms globally. The role will provide engineering, operational support, automation and lifecycle management for Microsoft Azure Stack HCI environments and associated technologies. The successful candidate ...
... using Azure Data Lake, Azure Synapse Analytics, Microsoft Fabric, Azure Databricks, and Azure SQL/Cosmos DB.- Architect AI/ML and Generative AI solutions using Azure Machine Learning, Azure AI Foundry, Azure OpenAI Service, and Cognitive Services.- Design data governance, security, and compliance frameworks using Microsoft ...
... with experience support in windows technologies (Azure active directory, Azure,Office365,M365,Intune, Application support, SOP based support), Tools such as Servicenow, Any Monitoring tools like Dynatrace Other business duties as assigned Technology Expertise Azure Active Directory,Azure,Office 365,Intune,Service Desk
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
Role Overview : The Senior GCP Cloud Network Engineer (C2) is a specialist Individual Contributor responsible for designing, implementing, operating, and optimizing GCP network infrastructure at https://jobeax.com/link/qAYqbkLnnVqh7KFx role focuses on deep technical execution, operational excellence, and collaboration, ...
... order to reach more people, more effectively. Join our team as a Azure DevOps Engineer , where you will design, deploy, and manage secure and scalable Microsoft Azure cloud infrastructure. You will work across Azure networking, PaaS services, Azure DevOps, Terraform, CI/CD, and DevSecOps while collaborating with development, ...
... infrastructure using Terraform and Ansible for repeatable and scalable deployments. Deploy and manage a wide range of Azure services including App Services, Azure SQL Elastic Pools, Virtual Machines, Service Bus, Key Vaults, and Recovery Services Vaults. Configure and manage Microsoft Entra ID (Azure AD) for identity governance, ...
About the job :We are looking for a highly skilled Azure DevOps Engineer to join the GEDU Product Engineering Team in Noida. In this role, you will be responsible for driving end-to-end DevOps automation, release management, infrastructure provisioning, and deployment governance across cloud environments. The ideal candidate ...
... fit right in to help our clients navigate their next in their digital transformation journey this is the place for you Primary skills Technology Cloud Platform Azure Devops Technology Java A b i l i t y t o w r i t e t e s t c a s e s a n d s c e n a r i o s b a s e d o n t h e s p e c i f i c a t i o n s G o o d u n d e ...
... development. If you love solving complex problems, working with cloud-native platforms, and mentoring engineering teams, we would love to hear from you. As a Azure DevOps Engineer, you will play a critical role in designing, automating, and scaling Sonatype's engineering platform and delivery systems on Azure. You will ...
... on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus). AWS/GCP/Azure Data Engineer Certification.