Databricks Architect/Engineer in Bengaluru, India - Jobeax
Vacancy description
Databricks Architect/Engineer in Bengaluru, India
Worksconsultancy
India, Bengaluru
Databricks Architect/Engineer in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
1. Solutioning & Architecture : - Translate client requirements into Databricks-based solution designs - data pipelines, Lakehouse layouts, and serving layers.- Recommend the right Databricks components (Delta Live Tables, Workflows, Unity Catalog, Databricks SQL, Genie) for a given use case, based on data volume, latency, and governance needs.- Participate in pre-sales and proposal discussions, contributing effort estimates and technical approach for Databricks-based engagements.- Review architecture decisions with senior architects and flag risks or better alternatives early.2. Hands-On Build & Delivery : - Build and maintain end-to-end pipelines : ingestion (Auto Loader, DLT), transformation (dbt or native PySpark/SQL), and serving (Unity Catalog, Databricks SQL).- Work directly with pharma commercial datasets - IQVIA, Symphony, CRM, Hub/SP, claims - modeling them into clean, governed Delta Lake structures.- Develop and maintain reusable components : notebooks, job templates, SQL libraries, and data quality checks.- Configure and tune Genie Spaces and AI/BI dashboards for client-facing analytics use cases.- Own workspace-level hygiene : cluster policies, job scheduling, cost tracking, and basic performance tuning.3. Platform Currency & Best Practices : - Stay closely tracked with new Databricks releases and features (e.g. Lakehouse/RT, Genie enhancements, Metric Views) and assess their relevance to pharma use cases.- Bring new capabilities into existing client engagements where they create real value, not just for novelty.- Contribute to and maintain co's internal Databricks standards, templates, and knowledge base.- Support the certification and upskilling of junior engineers and analysts on the team.4. Client & Team Collaboration : - Act as the day-to-day Databricks technical point of contact on assigned client engagements.- Explain technical trade-offs in plain terms to non-technical stakeholders when needed.- Collaborate with analytics, forecasting, and delivery teams to make sure the platform serves the actual business question, not just the data movement.5. Practice Building : - Help establish the Databricks practice - codifying reusable design patterns, reference architectures, and coding standards as the team's project count grows.- Design and build solution accelerators for common pharma use cases (prescription analytics, patient cohort analysis, omnichannel attribution) that can be reused and adapted across clients.- Maintain the internal Databricks knowledge base - templates, checklists, and lessons learned from delivery.- Support partnership conversations with Databricks by contributing technical input - solution briefs, architecture references, and demo material - that the practice lead and account teams can take into partner and client discussions.- Help identify gaps in team capability and contribute to certification and enablement plans for engineers joining the https://jobeax.com/link/eLxO3SLmpqvNPOZi : - Strong hands-on Databricks Architect/Databricks Engineer Profile with end-to-end build-and-solution capability and Databricks professional certification.- Must have 6+ years in Data engineering/Data architect roles, with at least recent 3 years of hands-on Databricks experience.- Must be able to design a solution end-to-end and then build it themselves.- Must have experience translating client/business requirements into Databricks solution designs - data pipelines, Lakehouse layouts, and serving layers.- Must have built and maintained end-to-end pipelines - ingestion (Auto Loader, DLT), transformation (PySpark/SQL or dbt), and serving (Unity Catalog, Databricks SQL).- Must hold at least one active Databricks Professional-level certification (Data Engineer Professional preferred), OR deep hands-on project experience with an Associate certification in hand.- Must have solid working knowledge across the Databricks stack - Delta Lake, Delta Live Tables, Unity Catalog, Auto Loader, Databricks SQL, Workflows, and cluster/job configuration.- Must have strong SQL and PySpark skills, able to read and reason about existing pipelines quickly.- Must be able to act as the client-facing Databricks technical point of contact and explain technical trade-offs in plain terms to non-technical stakeholders. (ref:hirist.tech)
... people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. You Will: - Data Architecture and Design: Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing ...
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...
... retention requirements into architecture and design decisions. - Define and promote standards for data quality, validation, cataloging, access controls, and engineering best practices. - Provide technical leadership and mentoring to data engineers, analysts, and architects to drive consistent adoption of standards and patterns. ...
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
Databricks Engineer Location - Remote Data & AI Platform Engineering (Databricks-Centric): Design, implement, and optimize end-to-end data pipelines on Databricks, following the Medallion Architecture principles. Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data ...
... every model — from classical ML to RAG pipelines and autonomous agents — is reproducible, explainable, observable, and production-safe. The incumbent will architect and implement the MLOps and LLMOps platform on Databricks, leveraging Agentbricks (Databricks Agent Framework), Databricks Apps, MLflow, Feature Store, Model ...
... Architect to understand data platform requirements and design specifications. Assist with data modelling and optimization tasks. Document the data platform architecture, processes, and best practices. Stay up to date with the latest trends and technologies in full stack development, data engineering, and DevOps. Proactively ...
... Knowledge of data security patterns: PII masking, tokenization, column/row-level security Informatica, ODI, or SSIS exposure Education & Certifications Bachelor's/Master's in Computer Science, Engineering, or equivalent AWS Certified Data Engineer, AWS Solutions Architect, Databricks, or Snowflake certifications are a plus
DevOps Engineer (2+ Years Experience) At bluCursor, we're looking for a passionate DevOps Engineer to join our growing team and help us build scalable, secure, and high-performing infrastructure for our global clients. Assist in building, managing, and optimizing CI/CD pipelines with tools like Jenkins, GitHub Actions, ...
... product and engineering leadership to drive technology vision, ensures world-class reliability, and delivers robust experiences for internal and external users. Architecture & Systems Design: Evaluate and select appropriate technologies, frameworks, and architecture patterns for real-time ad serving and measurement. Mentor, ...
... strategies. Knowledge of containerization (Docker, Kubernetes) and infrastructure as code. Consulting or client-facing delivery experience. Lead end-to-end solution architecture for Optimizely-based projects, from requirements gathering through deployment and support. Design scalable, maintainable, and secure architectures using ...
... Experience with GraphQL, Kafka, Databricks, or distributed data platforms. Experience with OpenTelemetry, Prometheus, Grafana, or New Relic. Experience mentoring engineers and contributing to architecture and technical strategy. Experience developing and deploying AI applications including chatbots, virtual assistants and other ...
... role based in Surat. The Architect will be responsible for developing architectural concepts, preparing design drawings and models, and coordinating detailed architectural design documentation for a variety of government, corporate, commercial, and residential projects. Daily tasks include collaborating with engineers, planners, ...
... experience with Microsoft Azure (Azure OpenAI Service, Cognitive Services, Azure Machine Learning) or https://jobeax.com/link/x0s8XtEWiLbcDcct Qualifications :- Databricks Certified Machine Learning Professional or Generative AI Engineer certification.- Microsoft Certified: Azure AI Engineer Associate (AI - 102).- Demonstrated ...
... experience with Microsoft Azure (Azure OpenAI Service, Cognitive Services, Azure Machine Learning) or https://jobeax.com/link/x0s8XtEWiLbcDcct Qualifications :- Databricks Certified Machine Learning Professional or Generative AI Engineer certification.- Microsoft Certified: Azure AI Engineer Associate (AI - 102).- Demonstrated ...
... authentication/authorisation, data protection, cyber security, performance, availability, observability). - Communicate decisions and trade-offs clearly to business and engineering stakeholders, highlighting risks, dependencies and https://jobeax.com/link/iiiFQRon7dfY0tXk governance and risk management—produce architecture deliverables, ...
... requirements, make trade-offs transparent, and drive decisions when ownership is https://jobeax.com/link/HLsikUBtnTuAcImv Certifications : - Databricks Data Engineer Professional or Databricks Machine Learning Professional.- AWS Certified Data Analytics, AWS Solutions Architect Associate, or AWS Solutions Architect Professional.- ...
... validation de la documentation technique, participation aux revues de conception). Rédiger des documents techniques liés aux sous-systèmes (description client, architectures, notes de calcul, spécifications de test, etc.). Participer des réunions et présentations avec les clients. Assurer la mise en service et le réglage des ...