... integration, primarily using Azure Databricks , Azure Data Lake , and Microsoft Purview . Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks. Granular Data ...
... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...
... exposure to these technologies. ⚠️ If Databricks is not a core part of your recent hands-on experience, this role may not be the right fit. Job Title: Senior Data Engineer Specialization: Data Engineering | Databricks | Lakehouse | Data Platforms | AI-Ready Data Experience: 5+ Years Location: BNG | HYD | PUN | MUM | GGN ...
We're looking for a dynamic Senior Data Scientist to join our team, working alongside our founders, financial analysts, product managers, and engineers. This is your chance to get hands-on with massive datasets, crafting the metrics that matter to institutional investors worldwide. For those who are curious and passionate ...
... & Remote Operations YOUR TASKS: Build and maintain data pipelines to transform, process and ingest wind measurement and master data from multiple sources and data formats to drive analytical insights. Develop and optimize data models and schemas for storage and retrieval of structured andunstructured data Perform analysis ...
... Design and develop batch and real-time data pipelines on GCP.- Build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer.- Ingest data from databases, APIs, files, SaaS applications, and streaming sources.- Design and optimize BigQuery datasets, tables, partitioning, and clustering.- Develop data transformations ...
... tools. Data Modeling & Architecture: Skilled in dimensional and semantic modeling, database design, and building performant, governed analytics-ready structures. Data Quality, Metadata & Curation: Capable of cleansing, transforming, and validating data; familiar with lineage, cataloging, and data quality frameworks. Experience ...
Skills Required ~ Data Science Duties & Responsibilities Advanced statistics, predictive analytics. Advanced object-oriented programming Hadoop, MySQL, TensorFlow, Spark Machine learning, data modeling Good aptitude and communication Education & Training ~ IT Education
'We are looking for a detail-oriented Data Entry Operator to join our team. Your main task will be to enter data from various sources into our company computer system for processing and management. A successful candidate will be responsible for maintaining accurate, up-to-date, and useable information in our systems.' Requirements ...
Role Overview Application Senior Data (Platform) Engineer Location: Hyderabad | Department: Technology, Data About The Role Are you passionate about building reliable, scalable data platforms that make analytics and AI development easier As a Senior Data Platform Engineer, you will be hands-on in building, operating, and ...
... solution using available data You demonstrate hands-on experience with preprocessing, feature engineering, feature selection and data cleansing on real world datasets Preferably you have work experience in an engineering or technology role You bring a strong background of Python and handling large data sets using SQL in ...
... systems for ensuring data accuracy and compliance. Adept at collaborating with cross-functional teams and delivering solutions that align with business objectiv Data Analysis/Business Data Analyst/Technical Business Analyst Data Enginee ring (Data Governance(Collibra), Data Profiling, Data Modelling, Data Visualization) Data ...
... experience in BigData Development. ○ Strong Hands On Experience on Python, PySpark, Java Script, AWS, Cloud . Primary Skills ○ Knowledge of SQL and relational databases ○ Proficiency in developing, deploying, and debugging data-objects, and data transformation pipelines. ○ Expertise in data analysis methodologies ○ Exposure ...
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
... Working with relational and NoSQL databases Ensuring data quality, consistency, and reliability Building data processing and transformation workflows Monitoring data pipelines and troubleshooting failures Supporting data warehouse and data lake environments Documenting data pipelines, schemas, and processes Collaborating with ...
... . Good team player . Interest in technologies and innovation . Knowledge of formalisation and communication tools (MS Office - MS SharePoint) . Knowledge of statistical and datamining techniques (SAS, SPSS, VBA, ACCES) or SQL database languages . Proficient in English . Perfectly at ease in a multi-cultural environment