... (Terraform) and CI/CD frameworks (Tekton).- Cloud Optimization : Actively monitor and optimize cost and compute resources for high-intensity processes (Cloud Run, Dataflow, BigQuery) to ensure platform efficiency.- Data Governance & Security : Implement robust data encryption, masking techniques, and governance frameworks to ...
... every day. It is one of the world's largest IT infrastructure services providers and supports thousands of customers across more than 60 countries. Job Title: Data Analyst-Data Validation Work Mode: Hybrid Experience: 8+ yrs. Job Type : Contract to hire. Immediate joiners. Strong experience in SQL and Python Ability to engage ...
... and maintain scalable data pipelines for data processing and transformation Build and manage workflow orchestration using Apache Airflow Develop and maintain data models and transformations using dbt Work with BigQuery or similar cloud data warehouses for data storage and querying Manage and interact with cloud object storage ...
... cloud-native data services: Data lakes, data warehouses, and analytics services Identity and access management for data systems Data & Analytics Understanding of data governance and security principles Experience with data quality frameworks and monitoring Knowledge of dimensional modeling and data warehouse design Familiarity ...
Opportunity Overview We are looking for a Data Engineer to build and optimize scalable data pipelines and analytical datasets on our AWS-based lakehouse platform. You will work with Apache Iceberg, AWS Glue, Athena, dbt, and Airflow to support reliable and efficient data processing for analytics and operational use cases. ...
... Azure, leveraging Azure OpenAI Service, Azure ML, and App Services for robust scalability, monitoring, and compliance. - System Integration & Collaboration: Work closely with data engineers, solution architects, and business analysts to embed AI capabilities within existing insurance ecosystems integrating policy data, ...
We are looking for a talented and dynamic individual to join our Data Engineering team at Marsh Mc Lennan. This is a hybrid role that has a requirement of working at least three days a week in the office: Develop a deep understanding of Digital trading platforms and other systems to optimize them for the business Gain a ...
... at DTCC will consult with information technology, data analytics, business/ product creation and development staff to design and implement the blueprint of a database to store information for a specific system that will support the work of the enterprise. The DM will develop a detailed knowledge of the underlying data as ...
... (GIT), and CI tools (Jenkins, Fortify, Sonar) Code packaging and deployment automation. All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for ...
... ownership, OR - 2-3 years as Data/Backend Engineer with PM work (PRDs, roadmaps, user research) Technical Stack Depth Deep understanding: ETL/ELT pipelines, data warehousing, data lakes/lakehouses Advanced SQL (query optimization, not just SELECT statements) Hands-on with ONE of: Hive/Spark/Hadoop/HDFS, Snowflake/Databricks/BigQuery, ...
... consolidation, and upgrade initiatives.- Evaluate and recommend appropriate database technologies based on workload, scalability, performance, and business requirements.- Work closely with development teams to optimize SQL queries, stored procedures, database transactions, and data access patterns.- Establish database security standards ...
... (Airflow/Dagster/Step Functions) and CI/CD for data workloads. - Strong data quality/observability practices (tests, monitoring, lineage; Experience with SQL + NoSQL data stores (e.g., Postgres/MySQL; able to work with mixed audiences and translate needs into reliable data interfaces. - DSP/SSP/exchange/RTB concepts and data flows. ...
Pro Arch is seeking a Senior Data Engineer with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, ...
... a robust data governance framework using Collibra / Informatica IDC / AXON Collaborate with data stewards and business stakeholders to define data ownership, data quality standards and classification. Create and enforce data governance policies and procedures. Work with multiple stakeholders on Data Quality & Data Security ...
We are hiring for Senior Data Engineer (MS Fabric & Telecom) Work location: Bangalore, Karnataka, India Experince: 8 to 10 years Notice: Imdiate to 30 days only Role Overview As a Senior Data Engineer, you will be at the forefront of our data transformation, specifically architecting and building the next generation of ...
... organize, validate, and analyze collected datasets. Write database queries to pull, manage, and analyze information. Present data findings clearly to the team. Work with cloud-based databases and support data retrieval and validation activities. Understand how the software/application works and how data impacts different ...
... accountable for delivering exceptional results. Perform development work and technical support related to our data transformation and ETL jobs in support of a global data warehouse. Development of new ETL/data transformation jobs, using PySpark and IBM DataStage in AWS. Enhancement and support on existing ETL/data transformation ...
... in financial data, and a keen eye for resolving data quality issues. You will work with cross-functional teams to ensure accurate, reliable, and well-governed data across investment management platforms. Experience: 4-10 Years Review, analyze, and resolve data quality issues across the Investment Management (IM) data architecture. ...
... Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions - Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases) If you have a disability and need a workplace accommodation ...
... Procure-to-Pay, Record-to-Report, and Plan-to-Produce — and apply that context to ground AI solutions in real enterprise reality. - Work with modern cloud and data platforms including Databricks, SAP Datasphere, SAP HANA Cloud, AWS, Azure, and GCP, gaining hands-on experience with scalable AI workflows. - Collaborate across ...