About Durapid Durapid Technologies is a Microsoft Data & AI Solutions Partner and Databricks partner. We build data platforms, AI solutions and enterprise software for clients across India, the USA, the UK, the Middle East and Singapore.
The Role We’re looking for a Databricks Developer with 2-4 years of experience, who has worked with advertising and campaign data. You will build and maintain the pipelines that bring in data from Meta and other ad platforms, model it for performance reporting and attribution, and give marketing and analytics teams reliable, timely insight into spend, reach and returns.
Key Responsibilities
Build and optimise ETL/ELT pipelines on Databricks using PySpark, Spark SQL and Delta Lake.
Ingest campaign, ad set, ad-level and creative performance data from the Meta Marketing API, Google Ads, DV360, TikTok and similar platforms.
Model marketing data (impressions, clicks, CTR, CPC, CPM, conversions, ROAS, CAC) using a Medallion architecture (Bronze / Silver / Gold).
Combine ad-platform data with CRM, web analytics (GA4) and Conversions API/pixel events to support attribution and funnel reporting.
Deal with API rate limits, attribution windows, late-arriving data and backfills.
Orchestrate jobs with Databricks Workflows or Airflow, and manage data governance with Unity Catalog.
Prepare datasets for BI tools such as Power BI, Tableau or Looker, and for data science use cases like budget optimisation and marketing mix modelling.
Monitor pipeline health, data quality and cluster cost, and tune them as needed.
Must-Have Skills
2–4 years of hands-on data engineering experience, including at least 1.5 years on Databricks.
Strong skills in PySpark, SQL and Python.
Experience with Delta Lake, including MERGE/upserts, schema evolution and time travel.
Real experience ingesting and modelling advertising data, particularly from the Meta Marketing API / Ads Manager.
Working knowledge of campaign metrics and digital marketing concepts such as attribution, conversion events and audience segmentation.
Experience with REST API integration, including pagination, authentication tokens and incremental loads.
Experience on at least one cloud platform: Azure (preferred), AWS or GCP.
... scalable ETL/ELT pipelines to integrate disparate data sources, ensuring high data quality and availability for downstream analytics.- Develop and optimize complex data models within Snowflake and Databricks environments to support high-performance reporting and business intelligence requirements.- Collaborate with engineering ...
Delhi, भारत
View vacancy
CGI Information Systems and Management Consultants
... Delta Lake concepts (Time travel, ACID transactions).- Familiarity with CI/CD concepts and deploying code using Azure DevOps or GitHub Actions.- Prior experience working in an Agile/Scrum environment.- Certifications : Azure Data Fundamentals (DP 900) or Databricks Certified Data Engineer Associate. (ref:hirist.tech) []
... Skills and Experience : - 6 - 12 years of relevant professional experience, including strong hands-on experience in Azure Data Engineering.- Strong proficiency in Azure Databricks, Python, PySpark and SQL.- Experience with Azure Data Lake Storage (ADLS).- Hands-on experience with Azure Data Factory (ADF) or Databricks Workflows.- ...
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure ...
... and query optimization.- Hands-on experience with Azure Databricks for data engineering and transformation workloads.- Experience building and orchestrating data pipelines using Azure Data Factory (ADF).- Strong understanding of data engineering principles, ETL/ELT processes, data transformation, and pipeline orchestration.- ...
... requirements into scalable, production-grade data pipelines and Lakehouse https://jobeax.com/link/JJKfuHPEsmrFPG6l Responsibilities : - Data Pipeline & Lakehouse Engineering : Design, implement, and maintain high-performance batch and real-time streaming data pipelines using Python, PySpark, and Spark SQL on Azure Databricks ...
... and query optimization.- Hands-on experience with Azure Databricks for data engineering and transformation workloads.- Experience building and orchestrating data pipelines using Azure Data Factory (ADF).- Strong understanding of data engineering principles, ETL/ELT processes, data transformation, and pipeline orchestration.- ...
About the Job : We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).You will be responsible ...
We are looking for an experienced Azure Data Engineer with 8+ years of experience in Data Engineering, ETL/ELT development, Data Warehousing, and Azure Data Platform services. The ideal candidate should have strong expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse, ADLS, Informatica PowerCenter, PySpark, ...
... in Databricks, PySpark, Delta Lake, Unity Catalog, Azure Databricks, SQL, and dimensional data modeling. The candidate will act as the technical owner of the data platform, providing architectural direction, establishing engineering standards, mentoring teams, and ensuring scalable and high-performance data https://jobeax.com/link/XnflZD2dGSZYgXFG ...