Sr. Data Engineer in Ahmedabad, भारत

Job Title: Senior Data Engineer Company: Lead Data Analytics US Based company Location: Hyderabad (Max Budget: 22 LPA) | Ahmedabad (Max Budget: 20 LPA) Work Mode: 5 Days Work From Office (No Hybrid/Remote) Notice Period: Immediate to 15 Days Max Location Criteria: Strictly Local Candidates Only. (Candidates must currently reside in Hyderabad or Ahmedabad. Relocating candidates will not be considered). Role Summary We are seeking a highly skilled Senior Data Engineer to lead the design and implementation of scalable, high-performance data pipelines. In this role, you will define architectural best practices and drive data transformation at scale using Snowflake, dbt, Python, and SQL. You will own end-to-end project delivery, mentor junior engineers, and enforce data governance standards. While cloud-agnostic experience is welcome, a strong preference is given to candidates with Azure (ADF and Databricks) expertise. Key Responsibilities Pipeline Architecture: Architect and implement modular, test-driven ELT pipelines using dbt on Snowflake, leveraging advanced capabilities like macros, packages, custom tests, and version control. Data Ingestion & Transformation: Lead the ingestion of structured and semi-structured data from APIs, cloud storage, and databases. Write robust Python scripts for data transformation, automation, and integrations. Project Ownership & Leadership: Manage end-to-end project delivery in a consulting setup. Mentor small teams of junior engineers, lead code reviews, and establish reusable frameworks. Cloud Orchestration: Orchestrate workflows using dbt Cloud, Azure Data Factory (ADF), Airflow, or similar tools, integrated with CI/CD pipelines. Data Modeling: Design layered data models (medallion architecture: Bronze/Silver/Gold) and apply dimensional modeling principles (Star/Snowflake schemas, SCDs). Performance & Optimization: Optimize Snowflake for performance and cost, managing warehouse sizing, clustering, materializations, and query profiling. Governance & Security: Enforce data governance, compliance practices, RBAC, secure data sharing, and encryption strategies. Required Qualifications & Skills Experience: 5 to 8 years overall in data engineering, with 3+ years of mandatory hands-on experience in Snowflake and dbt in production environments. Core Tech Stack (Mandatory): Expert-level proficiency in SQL (querying/tuning), Python, Snowflake, and dbt. Cloud Experience: Strong hands-on experience with at least one major cloud platform. Azure (with ADF and Databricks) is highly preferred. Leadership: Proven experience as a Project Owner, including end-to-end delivery and handling/mentoring small teams. Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. Preferred/Bonus Skills (Nice to Have) Exposure to AI/ML data pipelines, feature stores, or MLflow. Previous experience with Matillion (Data Productivity Cloud or Matillion ETL). Certifications: Snowflake SnowPro Advanced, dbt Certified Developer, or equivalent Cloud certifications. Key Skills: Snowflake, DBT, Azure, ADF, Databricks, Python, SQL