... facilitate smooth data flow and integration. Enforce best practices in observability, data governance, security, and regulatory compliance Minimum 7 years as a Data Engineer or similar role. Hands-on experience with Databricks, Delta Lake, Spark, and Scala. Proven ability to design, build, and operate Data Lakes or Data Warehouses. ...
... relevant field, such as Life Sciences or Healthcare. - Proven experience in clinical data management within the pharmaceutical or biotechnology industry. - Familiarity with data management software and systems (e.g., Medidata, Oracle RDC, or similar). - Strong attention to detail and the ability to work effectively in a fast-paced ...
... and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management ...
... opportunity for a Data Scientist to join a new and rapidly growing intraday team. In this role you will partner with our close-knit team of quantitative researchers, data engineers, technologists and data sourcing colleagues to research, engineer, and validate quantitative signals derived from high-frequency equity market data ...
... the organization, ensuring our data infrastructure remains a competitive asset in a fast-paced https://jobeax.com/link/CO851KAPNv79RH57 Responsibilities : - Architect and maintain complex data models that serve as the foundation for enterprise-wide reporting and advanced analytics, ensuring high data integrity and performance.- ...
... build robust data pipelines, data lakes, and marts to support business analysts and data scientists. Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines ...
... DevOps / GitHub Actions) Infrastructure as Code (Terraform or ARM) Containerization (Docker) Experience with automated testing frameworks for data pipelines (unit testing, reconciliation-based validation) Nice to Have Experience with Unity Catalog for data governance and lineage Familiarity with Azure Purview for data cataloguing ...
... and Terraform. Build and expose the data lake/lakehouse so teams can understand business and product performance and make better decisions. Design and evolve a data platform that enables scientists and analysts to query, model, and ship features and product metrics. Maintain and fix existing ETLs, improving reliability, observability, ...
... Amazon Athena for querying and analyzing data stored in Amazon S3.- Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.- Collaborate with data architects, analysts, developers, and business stakeholders to understand data requirements.- Ensure data quality, security, governance, ...
Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Apply By Not Provided Posted 1 day ago Fresher Job Be an early applicant About the job Requirements Strong understanding of AWS architecture best practices, scalability, security, and cost optimization strategies. Strong hands-on ...
... the Role :We are seeking a Senior Fabric Data Engineer who can help with the design and building of data https://jobeax.com/link/jcqkTDCTdscBt8W9 :- Building Data Factory pipelines in Fabric- Scheduling notebook, Copy Activity, and Dataflow Gen2 executions- Creating dependency chains between activities- Implementing retry ...
... & Data Engineering (AWS) Strong handson experience with AWS data services, including: Amazon S3, AWS Glue, Athena, Redshift Experience designing cloudnative data lakes and data warehouse architectures on AWS Deep understanding of batch and streaming data pipelines Experience building scalable, faulttolerant data ingestion ...
... relevant reporting tools - Collaborate with data engineers, architects, and business stakeholders to deliver high-quality, scalable solutions. - Knowledge of data security, compliance, and governance best practices Familiarity with monitoring, alerting, and operational runbooks to support production-grade data pipelines ...
Senior Data Engineer Starts Immediately Competitive salary Competitive salary Experience We are looking for a Senior Data Engineer to join our team. In this role, you will design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will partner with data science, analytics, and business ...
... develop, and implement predictive models and algorithms using advanced statistical techniques and machine learning frameworks. Data Analysis: Conduct thorough data exploration, cleaning, and transformation to prepare datasets for modeling efforts, ensuring high data quality and accuracy. Collaboration: Work with cross-functional ...
... working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing 'big data' data pipelines, architectures and data sets. Experience performing root cause analysis of internal and external data and processes to answer specific business ...
... requirement gathering to post-migration validation. Execute data extraction, transformation, and loading (ETL) processes leveraging Guidewire Data Migration Suite, Mammoth tools, and relevant migration utilities. Collaborate with business analysts, data architects, and Guidewire developers to define data mapping, cleansing, ...
... ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) Excellent communicator (written and verbal formal and informal) Experience using software version control tools (Git/Bitbucket/code commit). Flexible and proactive/self-motivated working style ...
... OBJECTIVE : Data Scientist with 3+ years of experience in developing scalable Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience ...