... across technical and non-technical stakeholders. Preferred Qualifications - Experience with containerization technologies (Docker, Kubernetes). - Knowledge of data pipelines, data warehousing, or big data tools. - Familiarity with monitoring tools and performance optimization techniques. What’s in it for you? Pathways for ...
... redefine the future of how work gets done. Senior Data Engineer At Snowflake, we are building the future of the data-driven enterprise. We are looking for a Senior Data Engineer who brings deep technical craft, strong ownership instincts, and the ability to operate across the full data lifecycle — from raw ingestion to production-ready ...
... initiatives Strong experience in data analysis and implementing solutions within the Architecture space Must have Hands on experience in RDBMS in any one of the databases like Teradata/ MS SQL Server/Oracle/ IBM DB2/ Mongo DB along with Data Lineage, Data integrity and Data Analysis skills Technical skills in technologies ...
... Information Technology, Data Engineering, or a closely related discipline 2. Microsoft Certified: Azure Solutions Architect Expert or equivalent certification 3. Microsoft Certified: Azure Data Engineer Associate or similar certification Must-have skills Microsoft Azure, Synapse, Fabric Good-to-have skills PySpark, SQL, ETL
... Being Successful in This Role Minimum 5 years of experience in software development and system design Minimum 2 years of experience as a Data Engineer focused on data modelling, governance, and platform administration. Expertise in Snowflake or similar MPP databases. Strong SQL skills. Experience with multiple database technologies ...
... and digital trust capabilities. Our flexible and modularized methodology has been utilized by numerous global organizations to build a broad global privacy, data protection, and/or digital trust operations and includes the following phases and activities. Data lifecycle management Policy fine-tuning Cyber Data Operate ...
... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...
... skills with basic knowledge of algorithms/data structures and their application. Strong understanding of Data Engineering concepts including ETL, ELT, Data Lake, Data Warehousing, and Data Pipelines. Experience designing and implementing Data Lakes, Data Warehouses, and Data Marts that support terabytes scale data. A track ...
... Azure, AWS, GCP(preferred) Understanding of data warehousing, ETL/ELT, data integration, and data lake/lakehouse architectures . Knowledge of metadata management, data lineage, master/reference data, and data governance principles . Ability to translate business terminology and processes into structured data definitions and ...
... MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.12. Preferred Experience 2 : - Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems.13. Preferred Experience 3 : - Familiarity with Docker, Kubernetes, ...
... engineering strategy aligned to business objectives and technology direction - Shape the architecture then build and scale AI/ML and Generative AI platforms and associated applications - Embed reusable capabilities, frameworks, tooling and engineering standards across engineering teams - Partner with enterprise and solution ...
... reference data across asset classes, including Bonds, Commodities, IRD, FX, and Fixed Income products for Market Risk and FRTB. Maintain, query, and optimize risk data structures and databases for the risk engine and associated systems, establishing controls for data lineage, reconciliation, and data integrity. Develop and utilize ...
... taken care by the candidate. To be successful, you will: - Experience of modern architecture applying decomposing monolithic applications, APIs, micro services, data foundation, and leading Cloud Providers PaaS and IaaS capabilities. Cloud providers such as AWS, GCP etc. - Deep understanding of Database technologies (Mongo, ...
... containers as well as GCP suite, terraform kubernetes, cloud functions You understand standard ETL patterns, modern data warehousing ideas such as data mesh or data vaulting, and data quality practices regarding test driven design and data observability. You are passionate about all things data: Big data, small data, moving ...
... transformation, and loading (ETL) of data. Your responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. ...
... disruptions of the future. We are looking forward to hire Azure Data Lake (ADL) Professionals in the following areas : Role - Azure Data Engineer Azure Data Lake, Data Factory, Pipelines, Synapse (mandatory) SQL, Python, PySpark / Spark-SQL Web tech, relational DBs, data warehousing, ETL design Microsoft Certified Data Engineer ...
Qualification : BE/B.Tech/M.Tech - Computer/IT Experience : 3 to 5 Years Roles & Responsibilities: - Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation - Experience working with and creating cloud data solutions - Assemble large, complex data sets that meet functional/non-functional ...
Hi All, W are hiring Data Engineers, 4-9 years experience with below mandatory Skills . Job Location : Pan India ( Tech M Location) Azure Databricks, ETL, Pyspark & SQL, Medallion architecture Informatica knowledge. Fact & dimension table Medallion architecture Data bricks certification preferable ADF, Databricks, Pyspark, ...
... background in Python, PySpark, and SQL, to join our growing data engineering team. The ideal candidate will have hands-on experience with cloud data platforms, data modelling, and a proven track record of building and optimising large-scale data pipelines in agile environments. Design, develop, and maintain robust data pipelines ...