310 data associate remote jobs in Pune, India.

... and digital trust capabilities. Our flexible and modularized methodology has been utilized by numerous global organizations to build a broad global privacy, data protection, and/or digital trust operations and includes the following phases and activities. Data lifecycle management Policy fine-tuning Cyber Data Operate ...

... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...

... skills with basic knowledge of algorithms/data structures and their application. Strong understanding of Data Engineering concepts including ETL, ELT, Data Lake, Data Warehousing, and Data Pipelines. Experience designing and implementing Data Lakes, Data Warehouses, and Data Marts that support terabytes scale data. A track ...

... Azure, AWS, GCP(preferred) Understanding of data warehousing, ETL/ELT, data integration, and data lake/lakehouse architectures . Knowledge of metadata management, data lineage, master/reference data, and data governance principles . Ability to translate business terminology and processes into structured data definitions and ...

... MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.12. Preferred Experience 2 : - Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems.13. Preferred Experience 3 : - Familiarity with Docker, Kubernetes, ...

... engineering strategy aligned to business objectives and technology direction - Shape the architecture then build and scale AI/ML and Generative AI platforms and associated applications - Embed reusable capabilities, frameworks, tooling and engineering standards across engineering teams - Partner with enterprise and solution ...

... reference data across asset classes, including Bonds, Commodities, IRD, FX, and Fixed Income products for Market Risk and FRTB. Maintain, query, and optimize risk data structures and databases for the risk engine and associated systems, establishing controls for data lineage, reconciliation, and data integrity. Develop and utilize ...

... taken care by the candidate. To be successful, you will: - Experience of modern architecture applying decomposing monolithic applications, APIs, micro services, data foundation, and leading Cloud Providers PaaS and IaaS capabilities. Cloud providers such as AWS, GCP etc. - Deep understanding of Database technologies (Mongo, ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark, ...

... containers as well as GCP suite, terraform kubernetes, cloud functions You understand standard ETL patterns, modern data warehousing ideas such as data mesh or data vaulting, and data quality practices regarding test driven design and data observability. You are passionate about all things data: Big data, small data, moving ...

... transformation, and loading (ETL) of data. Your responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. ...

... disruptions of the future. We are looking forward to hire Azure Data Lake (ADL) Professionals in the following areas : Role - Azure Data Engineer Azure Data Lake, Data Factory, Pipelines, Synapse (mandatory) SQL, Python, PySpark / Spark-SQL Web tech, relational DBs, data warehousing, ETL design Microsoft Certified Data Engineer ...

Qualification : BE/B.Tech/M.Tech - Computer/IT Experience : 3 to 5 Years Roles & Responsibilities: - Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation - Experience working with and creating cloud data solutions - Assemble large, complex data sets that meet functional/non-functional ...

Hi All, W are hiring Data Engineers, 4-9 years experience with below mandatory Skills . Job Location : Pan India ( Tech M Location) Azure Databricks, ETL, Pyspark & SQL, Medallion architecture Informatica knowledge. Fact & dimension table Medallion architecture Data bricks certification preferable ADF, Databricks, Pyspark, ...

... background in Python, PySpark, and SQL, to join our growing data engineering team. The ideal candidate will have hands-on experience with cloud data platforms, data modelling, and a proven track record of building and optimising large-scale data pipelines in agile environments. Design, develop, and maintain robust data pipelines ...

... and build scalable data processing systems. The ideal candidate should have hands-on experience working with large datasets, distributed computing, and modern data architectures. Key Responsibilities Design, develop, and maintain big data pipelines using Hadoop and Spark Build scalable data processing frameworks using Scala ...

... the management of end-to-end data infrastructure—from design and construction to installation and ongoing maintenance of large-scale processing systems. Drive data quality initiatives, ensure seamless data accessibility for analysts and data scientists, and maintain strict compliance with data governance and regulatory requirements. ...

Key Responsibilities: Design and implement ELT processes for diverse data sources, including RDBMS, NoSQL databases, and data warehouses Develop and maintain scalable data pipelines for batch and stream processing using JVM-based languages and frameworks Collaborate with cross-functional teams to integrate diverse data ...

... to connect various data sources.- Schedule and monitor workflows using Apache Airflow to ensure timely data processing and delivery.- Troubleshoot and resolve data issues as they arise, ensuring data quality and integrity throughout the pipeline.- Document ETL processes, data models, and architecture to maintain clear and ...

... Generative AI to design, build, and deploy scalable data-driven solutions. The ideal candidate will work closely with business and engineering teams to transform data into actionable insights and production-grade AI systems. Key Responsibilities Data Science & Analytics Analyze large, complex datasets to identify trends, patterns, ...