671 data services jobs in Pune, India.

... for data processing and pipeline development.- Ensure data quality, governance, security, and compliance standards.- Monitor and troubleshoot data pipeline and database performance issues.- Implement automation for data validation, monitoring, and reporting.- Work with Apache Spark, Hadoop, and cloud data services.- Support ...

... system design and rapid product delivery. You will be responsible for building the backbone of our platform, moving seamlessly between high-performance NestJS services, event-driven architectures with Kafka, and scalable cloud infrastructure. Architect & Build: Lead the development of scalable backend services using https://jobeax.com/link/JSd7UYCSg572jJDY, ...

... metadata management, data lineage, master/reference data, and data governance principles . Ability to translate business terminology and processes into structured data definitions and models. Experience within banking, financial services, insurance, or other regulated industries (Preferred Private Banking) Familiarity with Data ...

... responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. - Cloud Services Integration: Leveraging ...

... responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. - Cloud Services Integration: Leveraging ...

... competitive advantage. Band: M3/M4 (6 to 14 years) Should have experience in PySpark and Scala + Spark for 4+ years (Min experience). Proficient in debugging and data analysis skills. Should have Spark experience of 4+ years Should have understanding of SDLC and Big Data Application Life Cycle Should have experience in GIT ...

... EMR, and other AWS services.- Develop PySpark-based data processing applications for large-scale distributed data workloads.- Write optimized SQL queries for data transformation, analysis, and reporting requirements.- Implement data ingestion frameworks to process data from databases, APIs, files, applications, and other ...

... background in Python, PySpark, and SQL, to join our growing data engineering team. The ideal candidate will have hands-on experience with cloud data platforms, data modelling, and a proven track record of building and optimising large-scale data pipelines in agile environments. Design, develop, and maintain robust data pipelines ...

... across technical and non-technical stakeholders. Preferred Qualifications - Experience with containerization technologies (Docker, Kubernetes). - Knowledge of data pipelines, data warehousing, or big data tools. - Familiarity with monitoring tools and performance optimization techniques. What’s in it for you? Pathways for ...

... solutions that meet organizational needs.- Implement and manage data integration solutions using IICS (Informatica Intelligent Cloud Services) to connect various data sources.- Schedule and monitor workflows using Apache Airflow to ensure timely data processing and delivery.- Troubleshoot and resolve data issues as they arise, ...

... years of experience • Minimum 3 years of experience in design, build and deployment of Ab Initio-based applications • Expertise in handling complex large-scale Data Lake and Warehouse environments • Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities • Excellent verbal ...

... scalable data pipelines for batch and stream processing using JVM-based languages and frameworks Collaborate with cross-functional teams to integrate diverse data sources into the data ecosystem Utilize AWS services for data storage, integration, and streaming solutions Maintain workflow orchestration using Apache Airflow ...

... Skills: Proficiency in Apache Spark, AWS Glue. Experience with data warehousing solutions and data lake architectures. Strong understanding of ETL processes and data integration techniques. Familiarity with cloud platforms and services, particularly AWS. Knowledge of data governance and data quality best practices. Additional ...

... data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks, Microsoft Azure Analytics Services, PySpark Minimum 3 Year(s) Of Experience ...

... data processing solutions using frameworks such as Apache Beam (Data Flow) and Kafka. Work with GCP services like BigQuery, Dataflow, and Spanner to optimize data pipelines and workflows. Design and model data structures for efficient data storage and retrieval. Oversee ETL processes to ensure seamless data extraction, ...

... business decisions. Focused on innovation and scale, Services provides data-driven capabilities across consulting, analytics, experimentation, and risk management. Data Platform & Orchestration is seeking a Lead Data Engineer to design and build next-generation, cloud-native data platforms supporting Mastercard's global data ...

... developing services using ASP NET Core Web API and Net Core for enterprise grade applications Demonstrate strong proficiency in Python for building backend services automation scripts and data processing pipelines aligned with oil and gas use cases Show proven expertise in managing containerized workloads on Kubernetes ...

... and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.- Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.- Automating data pipelines and workflows to streamline data ingestion, processing, ...

... inquiries related to Addepar’s portfolio data feeds and on general data product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage ...

... AI, and financial services data science, bringing innovative approaches into the organization. Bachelor's degree in Statistics, Mathematics, Computer Science, Data Science, Economics, Engineering, or another quantitative discipline. Master's or PhD is a plus. At least 3 years of hands-on experience in Data Science, Machine ...