... optimized SQL queries for data extraction, transformation, and analysis.- Build and manage ETL pipelines using AWS Glue.- Work with AWS Glue Data Catalog for metadata management and data discovery.- Design and implement serverless data processing solutions using AWS Lambda.- Use Amazon S3 for scalable data storage and data ...
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...
... inquiries related to Addepar's portfolio data feeds and on general data product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage ...
... Ensure the reliability, scalability, and efficiency of data pipelines for ingestion, transformation, and storage. Work with cross-functional teams to understand data needs and deliver high-quality solutions. Troubleshoot and resolve data pipeline issues in production environments. Apply data quality and governance best practices, ...
... Own end-to-end delivery of data products—from raw source data ingestion through transformation to governed, consumption-ready datasets. Collaborate with the Data Platform team on pipeline integration, CI/CD workflows, and adherence to shared coding and deployment standards. - Data Quality & Analysis: Implement data quality ...
... MAKE AN IMPACT Job Title: Data Engineer _DEPS Experience: 3–5 Years Location: Bangalore and Pune (Hybrid – Client Office) Job Summary: Seeking a skilled Senior Data DevOps Engineer having experience in Cloudera platforms, data engineering, and DevOps automation. The ideal candidate will manage and optimize Cloudera environments, ...
... deploying complex data architectures within Microsoft Fabric and the broader Azure ecosystem.- Advanced proficiency in Python and SQL for building sophisticated data processing pipelines and complex analytical models.- Strong background in data engineering principles, including ETL/ELT design, data modeling, and performance ...
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark, ...
Required Skills :- Solid hands-on experience in various databases, data mining and data analysis methods, utilizing advanced data tools, writing complex SQL queries.- Data preparation, data analysis, identify insights from raw data.- Analyses metrics, key indicators and other available data sources to discover root causes ...
... candidate will leverage generative AI and large language models (LLM) to enhance our data-driven decision-making processes. Key responsibilities : Design and develop data models using generative AI and LLM technologies. Implement retrieval-augmented generation techniques to improve data accessibility. Analyze complex datasets to ...
... pipelines Automate workflows for data ingestion, preprocessing, training, validation, and deployment Establish monitoring and alerting systems for model performance, data drift, and infrastructure health Ensure reproducibility, traceability, and compliance with regulatory standards Work closely with data scientists, data engineers, ...
We are seeking an experienced Lead Data Analyst to work on large-scale Energy & Utilities datasets. The ideal candidate will be responsible for analyzing tariff and pricing data, building data models, automating workflows, and delivering actionable insights to support business decisions.Role: Lead Data AnalystExperience: ...
Company : Very big MNCRole : GCP Data EngineerExperience : 8 - 15 yrsNotice Period : 30 daysLocation : PAN INDIATech Stack :- GCP data engineer- Pyspark- Dataflow- Dataproc- BigQuery- AirflowKey Responsibilities :- Design, develop, and optimize endtoend data pipelines using PySpark, Dataflow, and Dataproc- Implement data ingestion, ...
... relocation Remote Type: This position is fully remote Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and ...
... etc). Create visualizations to help us deeply understand what our networks learn and why. Very comfortable writing Python. Atleast 3-6 years of experience in Data Science Strong data structures, algorithms, and engineering mathematics background. Familiar with PyTorch and training deep neural networks is preferred but not ...
... composable platform, Aera empowers organizations to optimize and automate all types of decisions, across every business area. We are looking for an Associate Data Scientist who is exceptional at understanding data, extracting insights, and turning those insights into robust machine learning or statistical models. You will ...
About the Role : We are looking for a Data Scientist who combines strong machine learning fundamentals with a hands-on, exploratory mindset. In this role, you will own the full lifecycle of machine learning solutions - from framing the business problem and exploring data to building models and deploying them into production. ...
About the role :We are scaling our geospatial data-science capability - turning multi-source data (mobility, points of interest, demographic datasets, transaction signals, satellite imagery) into validated location attributes at fine spatial granularity (grid- and address-level) and powering ML models that are served as ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...