Data Ops/Engineer (for Market Data Projects with Capital markets exp.) in भारत
Luxoft
RemoteWork from anywhere
भारत
Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics
Responsibilities
Web scraping using scripts/APIs/Tools
Help build and maintain greenfield data platform running on Snowflake and AWS
Understand the existing pipelines and enhance pipelines for the new requirements.
Onboarding new data providers
Data migration projects
Skills
Must have
10+ years of exp as Data Engineer
SQL
Python
Linux
Containerization(Docker, Kubernetes)
Good communication skills
AWS
Strong on Dev ops side of things(K8s, Docker, Jenkins)
... automation and AI agents for file monitoring, data quality alerts and exception resolution, from initial ideation through implementation and adoption, partnering with BDO product managers, engineers and data stewards. Qualifications & Requirements: Required: - 10+ years of relevant experience in large-scale data operations, ...
... ceremonies and collaborate across analytics and engineering teams to deliver against priorities. Qualifications & Experience - Bachelor’s degree in Computer Science, Information Science or a related field. - 5+ years of experience in HR data management, including at least 2 years working with Workday data. - Strong understanding ...
... coordinate legal holds - Support the administration of legal holds, including issuance, amendments, reminders, compliance monitoring, and releases - Partner with attorneys and case teams to identify custodians, relevant date ranges, data sources, and preservation and collection requirements What you need - Litigation - ...
... certifications such as Azure Data Engineer Associate or Azure Data Scientist Associate are highly preferred. - Experience with Big Data Technologies: Exposure to big data technologies such as Hadoop, Spark, or Databricks. - Programming Skills: Knowledge of programming languages like Python or R for advanced data analysis. - Experience ...
... Needs 6+ years. What you'll do - Build and manage data pipelines and ETL processes - Work with large datasets using tools like Spark, Hadoop, or SQLrnEnsure data quality and performance optimizationrn What you need - SQL - Python - ETL - Spark - Hadoop - Data warehousing Good to have - Data modelling - Airflow - Data visualisation ...
... What you'll do - Preparation of PFDs, schematics/P&IDs, Data sheets. Commenting/review on the same for completeness - Participating in IDC process. Interaction with Engineering disciplines, Clients / PMC, Bidders / Vendors - Design, preparation of Mechanical Data Sheets /Engineering drawings, Material Requisition. Review ...
... annotation ops, and vendor contracts, identifying cost-optimization opportunities - Translate ambiguous problems into structured, actionable plans What We're Looking For: - 6+ years of experience spanning program/project management, business operations, or management consulting — ideally with exposure to automation, Ops, vendor ...
... What you'll do - Preparation of PFDs, schematics/P&IDs, Data sheets. Commenting/review on the same for completeness - Participating in IDC process. Interaction with Engineering disciplines, Clients / PMC, Bidders / Vendors - Review of deliverables of Process Package What you need - Mechanical engineering - Compensation and ...
... experience in data engineering or analytics engineering in a private, public, government or military environment. - Hands-on experience with SQL and relational databases, plus Python and PySpark for data processing and transformation. - Experience with Databricks and Lakehouse/Medallion architecture, and with AWS data services ...
... graph data, connecting information into meaningful business domains and broader enterprise data models. Your role and impact As a Data Engineer within Aladdin Data, you will build scalable data solutions and develop strong data models that connect technology with business context. You will work across the data lifecycle, ...