Back to list

Vacancy description

Ness Technologies - Data Architect - Azure/Databricks in Hyderabad, भारत

NESS DIGITAL ENGINEERING (INDIA) PRIVATE LIMITED

Hyderabad, भारत

Key Responsibilities :- Design and implement enterprise data warehouses and modern data platforms on Azure and Databricks.- Define data architecture standards, patterns and best practices, including lakehouse design on Delta Lake.- Build and optimise data solutions using Azure Synapse Analytics (Dedicated and Serverless SQL Pools), Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS Gen2).- Develop large-scale data processing on Databricks using Spark (PySpark/Scala), Delta Lake and MLflow.- Design data models using 3NF, dimensional, Data Vault and canonical approaches to suit business and reporting needs.- Write and tune complex SQL for performance and scalability.- Plan and lead migration from traditional platforms (Oracle, Teradata, SQL Server, Informatica) to modern cloud-based ELT/ETL frameworks.- Set up data governance, metadata management, data quality and security controls, using tools such as Azure Purview.- Design and build real-time and streaming data pipelines using Kafka, Event Hub or similar technologies where required.- Guide and mentor data engineers, and review designs, code and pipelines.- Work with business, analytics, AI/ML and infrastructure teams to understand data needs and deliver the right solutions.- Prepare architecture documents, data models, data flow diagrams and technical https://jobeax.com/link/V5ifB6V16Gdhz3Qz Have :- Proven experience as a Data Architect or Senior Data Engineer/Lead designing and implementing enterprise data warehouses and modern data platforms.- 8 - 12 years of experience in Data Engineering/Architecture, with at least 5+ years in Azure & Databricks ecosystem.- Hands-on expertise with Azure services: Azure Synapse Analytics (Dedicated SQL Pools, Serverless Pools), Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Purview.- Strong expertise with Databricks: Delta Lake, Lakehouse, Spark (PySpark/Scala), MLflow.- Very strong SQL development and optimization skills.- Strong data modeling (3NF, Dimensional, Data Vault, Canonical Models, etc.).- Knowledge of traditional data platforms (Oracle, Teradata, SQL Server, Informatica, etc.) along with modern ELT/ETL frameworks.- Solid understanding of data governance, metadata management, data quality, and security.- Experience in building real-time/streaming data pipelines (Kafka, Event Hub, etc.) is a plus. (ref:hirist.tech)

Similar vacancies

More like this role

NESS DIGITAL ENGINEERING (INDIA) PRIVATE LIMITED

Ness Technologies - QA Automation Engineer - Python/Selenium

... of experience in Agile processes (Scrum preferred).- 3+ years of experience of working with REST service and understanding of SOA architecture.- Knowledge of OData and SOAP preferred.- Experience creating/maintaining automation frameworks preferred.- Experience of DevOps pipeline in containerized environment using Azure ...

Hyderabad, भारत

  • Full-time
... ETL to build data pipelines to support automated reporting - Interface with other technology teams to extract, transform, and load data from a wide variety of data sources - Implement data structures using best practices in data modeling, ETL/ELT processes, and SQL, Redshift What you need - SQL - Python - ETL - Data modelling ...

Hyderabad, भारत

... Core Java, microservices, and distributed architecture.- Define and drive High-Level Design (HLD) and Low-Level Design (LLD) for complex software solutions.- Architect and implement distributed applications using Apache Kafka and other relevant technologies.- Apply appropriate design patterns, coding standards, and software ...

Bangalore, भारत

CELEBAL TECHNOLOGIES PRIVATE LIMITED

Celebal Technologies - Databricks Solution Architect

  • On-site
  • Full-time
... architecting scalable data and analytics solutions on Databricks, including data pipelines, data models, and integrations with cloud and enterprise systems. The Databricks Solution Architect will work closely with clients and internal stakeholders to understand business requirements, translate them into technical architectures, ...

Jaipur, भारत

  • Full-time
... https://jobeax.com/link/zbloX5fjTGGPSo3G : - Spring Framework - solid understanding of layered architecture and modules (Spring Core, Spring Boot, Spring MVC, Spring Data, Spring Security, Spring Cloud, etc.).Architecture & Design : - Practical understanding of Microservices architecture - knowing when and where to apply it.- Experience ...

Chennai, भारत

... TypeScript).- Problem-Solving Mindset : Exceptional analytical skills with a track record of diagnosing and resolving complex distributed systems problems.- Database & Cloud : Proficiency in relational/NoSQL databases and cloud-native environments (AWS/Azure/OCI).Preferred / Advantageous Skills : - Hands-on experience ...

Hyderabad, भारत

Sopra Steria

Data Architect

  • Full-time

€5.6 EUR

... aligning business goals with technology, ensuring data quality, and enabling advanced analytics and AI/ML use cases. Experience: 1. 10+ years of experience in data engineering/management roles 2. 2+ years in enterprise-level data architecture and data governance 3. Experience of design and validate Data architecture standards ...

Noida, भारत

  • Full-time
... you'll do - Define end-to-end data architecture: ingestion, storage, processing, serving and analytics layers - Design data lakes, lakehouses and warehouses on Azure, AWS or GCP (Snowflake, Databricks, Synapse, BigQuery, Redshift) - Build conceptual, logical and physical data models (dimensional, Data Vault, 3NF) What you ...

Hyderabad, भारत

  • Full-time
... data modeling, data warehousing, and database design (both relational and NoSQL). - Strong proficiency in data engineering, including experience with ETL tools, data integration frameworks, and big data technologies. - Hands-on experience with cloud data platforms (e.g., Azure, Google Cloud) and modern data processing frameworks. ...

Pune, भारत

  • Data Science
... Hugging Face).- Proven expertise in NLP, Computer Vision, or Generative AI (Transformers, RAG, LLMs, CNNs, Vision Transformers).- Hands-on experience with Big Data technologies (Spark, Hadoop, Kafka, Hive).- Strong knowledge of SQL and data pipelines. Experience with cloud platforms (Azure ML, AWS SageMaker, or GCP AI Platform).- ...

Hyderabad, भारत