... develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 ...
... transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Lead Data Engineer Who is Mastercard Mastercard is a global technology company ...
... models in production at scale — not prototypes or PoCs alone; evidence of model lifecycle ownership from training through retirement. Proven experience with Azure Databricks in an enterprise context — ideally within BFSI (banking, financial services, insurance), e-commerce, or a large-scale consumer data platform. Experience ...
About the Role:We are looking for an experienced AWS Data Engineer with 6 - 8 years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions on AWS. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS data services, with experience building robust ...
... Collaborate with data scientists and business stakeholders to operationalize computational and statistical models in production environment. Integrate backend services with Azure cloud components, including Azure Data Lake Storage, Databricks Delta Lake, and Azure DevOps. Develop reusable, modular, and maintainable code following ...
As the leading provider of workforce solutions, and with services across 60+ countries, we innovate, consult, design, and implement successful, creative, and data-driven talent solutions across all workforce categories.. We know what it takes to attract the best talent while designing and executing strategies that align ...
... MAKE AN IMPACT Job Title: Data Engineer _DEPS Experience: 3–5 Years Location: Bangalore and Pune (Hybrid – Client Office) Job Summary: Seeking a skilled Senior Data DevOps Engineer having experience in Cloudera platforms, data engineering, and DevOps automation. The ideal candidate will manage and optimize Cloudera environments, ...
... Talend, or Azure Data Factory. Strong Python development skills, including experience with AWS SDKs such as Boto3. Experience working with cloud platforms and data services, preferably AWS. A solid understanding of data warehousing, distributed data processing, and modern data architecture principles. Experience within the ...
... inquiries related to Addepar's portfolio data feeds and on general data product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage ...
... distributed architectures, and modern data engineering https://jobeax.com/link/TtkK7BHPbancvnFq Responsibilities:- Design, develop, and maintain scalable ETL/ELT data pipelines.- Build and manage distributed and event-driven architectures for large-scale data processing.- Develop backend services and data infrastructure using ...
... project services in a cost efficient manner to Corning worldwide. Role Summary: The Data Architect is responsible for the design and evolution of our enterprise data architecture, with a strong focus on reusable data pipelines, data schemas & products, and modern data engineering practices. This role requires an AI-first mindset ...
... testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management ...
Position: Senior Data Engineer Location: Pune Job Responsibilities Design, develop, and maintain scalable data pipelines using AWS services. Design and implement scalable, secure, and resilient MLOps architecture across cloud and on-prem environments Define best practices for model lifecycle management, including versioning, ...
... etc). Create visualizations to help us deeply understand what our networks learn and why. Very comfortable writing Python. Atleast 3-6 years of experience in Data Science Strong data structures, algorithms, and engineering mathematics background. Familiar with PyTorch and training deep neural networks is preferred but not ...
... zero carbon emissions by 2050. To make this transition, senior software engineers need to power our business end to end, from building new infrastructure and services through to customer facing web and native mobile applications. We are hiring passionate AI Software Engineers (Data Scientists) with experience in Python Programming ...
... design, and performance optimization.- Familiarity with generative AI platforms and use cases.- Contributions to open-source projects or thought leadership in data engineering/architecture.- Experience with Agile methodologies, CI/CD, and DevOps practices.- Exposure to FastAPI, or API-based ML services.- Experience evaluating ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... years of experience • Minimum 3 years of experience in design, build and deployment of Ab Initio-based applications • Expertise in handling complex large-scale Data Lake and Warehouse environments • Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities • Excellent verbal ...
... standards, and applicable regulatory requirements. Investigate day-to-day production incidents by analyzing application logs, system metrics, and monitoring data to identify root causes and escalate complex issues appropriately. Troubleshoot, debug, and support Java-based applications and services under the guidance of ...