About Durapid Durapid Technologies is a Microsoft Data & AI Solutions Partner and Databricks partner. We build data platforms, AI solutions and enterprise software for clients across India, the USA, the UK, the Middle East and Singapore.
The Role We’re looking for a Databricks Developer with 2-4 years of experience, who has worked with advertising and campaign data. You will build and maintain the pipelines that bring in data from Meta and other ad platforms, model it for performance reporting and attribution, and give marketing and analytics teams reliable, timely insight into spend, reach and returns.
Key Responsibilities
Build and optimise ETL/ELT pipelines on Databricks using PySpark, Spark SQL and Delta Lake.
Ingest campaign, ad set, ad-level and creative performance data from the Meta Marketing API, Google Ads, DV360, TikTok and similar platforms.
Model marketing data (impressions, clicks, CTR, CPC, CPM, conversions, ROAS, CAC) using a Medallion architecture (Bronze / Silver / Gold).
Combine ad-platform data with CRM, web analytics (GA4) and Conversions API/pixel events to support attribution and funnel reporting.
Deal with API rate limits, attribution windows, late-arriving data and backfills.
Orchestrate jobs with Databricks Workflows or Airflow, and manage data governance with Unity Catalog.
Prepare datasets for BI tools such as Power BI, Tableau or Looker, and for data science use cases like budget optimisation and marketing mix modelling.
Monitor pipeline health, data quality and cluster cost, and tune them as needed.
Must-Have Skills
2–4 years of hands-on data engineering experience, including at least 1.5 years on Databricks.
Strong skills in PySpark, SQL and Python.
Experience with Delta Lake, including MERGE/upserts, schema evolution and time travel.
Real experience ingesting and modelling advertising data, particularly from the Meta Marketing API / Ads Manager.
Working knowledge of campaign metrics and digital marketing concepts such as attribution, conversion events and audience segmentation.
Experience with REST API integration, including pagination, authentication tokens and incremental loads.
Experience on at least one cloud platform: Azure (preferred), AWS or GCP.
Azure Data EngineerKey Responsibilities:- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).- Build and optimize data processing workflows using Azure Databricks and Python.- Develop ETL/ELT processes to extract, transform, and load data from multiple sources.- Work with structured and ...
... improve data processing efficiency.- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data ...
... improving user retention. The scope also includes partnering closely with Product teams to enhance user experience, optimize engagement funnels, and execute data-driven growth initiatives at scale. - Own end-to-end growth and marketing across paid, organic, influencer, and performance channels to drive user acquisition ...
... Governance: Experience implementing data quality frameworks, data observability, and Unity Catalog-based https://jobeax.com/link/jNu8rE2vHzGnMJ64 Qualifications:- Databricks Certified Data Engineer Professional or Associate; AWS Certified Data Engineer or Azure Data Engineer Associate.- Experience delivering data platforms across ...
... independence and autonomy while contributing to the technical maturity of the organization. Qualifications Qualifications & Skills - Experience: 5+ years of Data Engineering experience, including 4+ years designing and building Databricks data pipelines is essential. While Azure cloud experience is preferred, we are happy ...
... seeking a skilled Senior Data Engineer with expertise in Databricks to join our dynamic data team. The ideal candidate will design build and maintain scalable data pipelines and architectures to support our organizations data-driven initiatives and leverage Databricks to process large-scale datasets optimize data workflows ...
... in this role - 6–8 years of experience in Data Engineering and Data Warehousing, with strong hands-on technical expertise. - Strong hands-on experience with Azure data services, including ADLS Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Event Hubs, and Azure Functions. - Proficiency in SQL, query ...
... Tableau, Looker).- Experience with data mesh concepts, data contracts, and domain-driven design in data platforms.- Certifications in cloud data platforms or data engineering (e.g., Azure/Databricks) is a https://jobeax.com/link/RUIf66uFNIVGK62z Stack:- Data modeling, ETL/ELT, SQL, Databricks, Spark, Azure Fabric/ADF, Power ...