... data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog ...
... non-technical stakeholders why data is or is not ready, and that conversation matters as much as the pipeline. Useful, Not Essential - Manufacturing or industrial data experience - Kafka, Debezium or other change-data-capture tooling - Metadata catalogue and governance tooling - Experience defining acceptance criteria on a client ...
... others. Required qualifications and experience: - Bachelor's degree in a relevant field, such as Life Sciences or Healthcare. - Proven experience in clinical data management within the pharmaceutical or biotechnology industry. - Familiarity with data management software and systems (e.g., Medidata, Oracle RDC, or similar). ...
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities ...
... markets, while owning the full lifecycle of a signal, forming a hypothesis about what market behavior predicts, engineering it into a feature, validating it with data, and shipping it into a production research platform. This is a research-focused data science role with meaningful hands-on coding and implementing signals within ...
... protocols Candidate Qualifications - Education: Bachelor's degree in computer science or equivalent - Experience: 4 - 8 years of experience in data engineering or data application development (ETL/ELT/BI) - 2+ years of experience in cloud-based data platform development - Expertise in building Azure-based data pipelines, including: ...
... collaborative mindset with the ability to thrive in a hybrid work environment across Bangalore, Chennai, Pune, or Mumbai.- A Bachelors or Masters degree in Computer Science, Information Systems, or a related quantitative field is preferred.- Candidates must possess 8 to 12 years of relevant professional experience in data engineering ...
Job Description – Senior Data Engineer / Platform Re-Engineering Lead (Azure Synapse & Databricks Migration) Role Overview We are looking for a highly experienced Senior Data Engineer to lead the re-engineering of an existing enterprise data platform built on Azure Synapse Analytics. The role requires deep technical seniority ...
Data Science Data Engineer Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. ...
... optimized SQL queries for data extraction, transformation, and analysis.- Build and manage ETL pipelines using AWS Glue.- Work with AWS Glue Data Catalog for metadata management and data discovery.- Design and implement serverless data processing solutions using AWS Lambda.- Use Amazon S3 for scalable data storage and data ...
... techniques. Hands-on experience integrating and optimizing Starburst/Trino, including connecting Starburst from Lambda and Glue ETL jobs. Experience with NoSQL databases such as DynamoDB, MongoDB. Experience working with data formats including Avro, Parquet, JSON, XML, and CSV. Comfortable challenging your peers and leadership ...
... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...
... & Data Engineering (AWS) Strong handson experience with AWS data services, including: Amazon S3, AWS Glue, Athena, Redshift Experience designing cloudnative data lakes and data warehouse architectures on AWS Deep understanding of batch and streaming data pipelines Experience building scalable, faulttolerant data ingestion ...
... work independently and collaboratively to solve complex data challenges and drive continuous improvements across our data engineering practices. 4+ years of data engineering experience, building and managing large-scale data pipelines - Strong proficiency in Python, PySpark, Spark, Databricks, Delta Lake, PowerBI and SQL, ...
Senior Data Engineer Starts Immediately Competitive salary Competitive salary Experience We are looking for a Senior Data Engineer to join our team. In this role, you will design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will partner with data science, analytics, and business ...
... science and machine learning to continuously enhance modeling practices and methodologies. Required Experience and Skills – Our Must haves: - Bachelor's degree in Data Science, Computer Science, Statistics, Mathematics, or a related field; 8+ years of experience in data science with a strong focus on model development and algorithm ...
... capture the most granular data. Align the engineering and product teams on the Data Granularity and accuracy requirements. Build Alerts to detect bugs in the data pipeline. Perform data analysis to test hypothesis and uncover factor influencing metric variations Build Feature Store for Data Science implementations Overall ...
... mapping, and change detection. - Ensure annotation accuracy, consistency, and adherence to defined quality standards (QA/QC frameworks) across all delivered datasets. - Define and continuously improve annotation guidelines, taxonomies, and labeling protocols in collaboration with Data Science and ML teams. - Stay current ...
... product into an innovative industry leader. Work with data and analytics experts to strive for greater functionality in our data systems. Qualifications For Data Engineer We are looking for a candidate with 3+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, ...