Back to list

Vacancy description

Senior Data Engineer (Investment Data) in भारत

Luxoft

  • RemoteWork from anywhere

भारत

We’re looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back office. The ideal candidate has financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrives in ambiguous environments—proactively shaping solutions, not waiting for tickets. You’ll own data end-to-end: from ingesting vendor and internal sources, to modeling in our lakehouse, to making data discoverable, reliable, and cost-efficient. You’ll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.

Responsibilities

Participate in requirements clarification and sprint planning sessions.

Design technical solutions and implement them, inc ETL Pipelines – Build robust data pipelines in PySpark to extract, transform, using PySpark

Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability

Writing unit and integration tests.

Support QA teammates in the acceptance process.

Resolving PROD incidents as a 3rd line engineer.

Skills

Must have

Bachelor’s degree (Computer Science, Engineering, Information Systems, or related discipline).

5+ years experience in data engineering roles (flexible based on depth of capability).

Strong hands-on experience with Databricks in production environments (prerequisite).

Strong programming experience with PySpark (must) and strong SQL (must).

Proven experience with Declarative Pipelines / pipeline orchestration on Databricks (prerequisite).

Strong understanding of data engineering fundamentals: ingestion patterns, transformation design, incremental processing, testing, performance tuning.

Experience delivering production-ready datasets with appropriate operational controls (monitoring, troubleshooting, reliability patterns).

Experience with modern Lakehouse concepts (Delta tables, optimization strategies, file skipping, metadata/statistics awareness).

Exposure to data governance practices: cataloguing, documentation, business glossary/terms, lineage.

Experience working in enterprise environments with CI/CD pipelines and structured release processes.

Familiarity with vendor market data feeds (e.g., Bloomberg, Refinitiv, MSCI, FactSet) or similar multi-source mastering patterns.

Nice to have

Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.

Proven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.

Familiarity with Dynatrace or Datadog for system observability and monitoring.

Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

Other

Languages

English: C1 Advanced

Seniority

Senior

Similar vacancies

More like this role

... practices around data engineering.- Lead architecture discussions, align with business needs, security, and best practices.- Has strong conceptual understanding of Data Warehousing and ETL, Data Governance and Security, Cloud Computing, and Batch & Real Time data processing.- Has strong execution knowledge of Data Modeling, Databases ...

Hyderabad, भारत

  • Remote
  • Hybrid
  • Full-time
Mid-level data science role at Progress in Bengaluru. Needs 4+ years and a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. Hybrid. What you'll do - Develop and manage data models, identity resolution rules, and segmentation frameworks - Develop and implement data normalization processes to ensure consistent, accurate, ...

Bangalore, भारत

  • Full-time
... identity resolution rules, and segmentation frameworks - Develop and implement data normalization processes to ensure consistent, accurate, and usable customer data - Maintain comprehensive documentation of platform configurations, operational workflows What you need - Data warehousing - Machine learning - ETL - Data privacy ...

Bangalore, भारत

Youth4 Talent Solutions and Services

Senior Data Engineer - Python/Big Data

... up-and-coming data management and software engineering technologies into existing data structures.- Develop set processes for data integration, data mining, data modeling, and data production.- Research new uses for existing data.- Collaborate with members of your team (e.g., Business Analysts, the IT team, data scientists) ...

Bangalore, भारत

... of the data engineering team and working on in-house products in for Data Foundation Collaborating closely with Data Engineering Leads and managers and other DataOps teams. This role involves hands-on development work and will directly report to Data Engineering Lead. Must have skills: - Azure Databricks, Unity Catalog, ...

Hyderabad, भारत

Rs 10 - 20 lakhs p.a.

Senior data science role at CloudKaptan in Kolkata. Needs 5+ years and a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. Pays ₹10–20 LPA. What you'll do - Architect, build and maintain data warehouses and our next-gen cloud data platform - Design and implement scalable data models and ETL/ELT pipelines using Databricks, ...

Calcutta, भारत

Procter & Gamble

Senior Data Engineer

HYDERABAD OFFICE APAC PSC GDOP Job Description CF-IT's TOP organization is seeking a Senior Data Engineer , located at the Hyderabad IT Hub. Specifically, you'll work within the Data & AI section that supports the Modern IT Service & Asset Management team. Responsibilities: Leading design and development of data and analytics ...

Hyderabad, भारत

... Java, Scala, or Golang. Big Data & Analytics Concepts: Data modeling, star schemas, slowly changing dimensions (SCD), Apache Beam, and dbt. Education & Experience: Typically a Bachelor’s or Master’s degree in Computer Science or Engineering, Nice to have Banking Other Languages English: C2 Proficient Seniority Senior []

Pune, भारत

Procter & Gamble

Senior Data Engineer

  • Full-time
... Warehousing, Lakehouse, Data Mesh, and Data Quality. - Knowledge in cloud technologies (Azure Cloud, Google Cloud) – at least 3 years inclusive of software engineering experience like API development - Extensive knowledge of modern Big Data architecture: Data Warehousing, Lakehouse, Data Mesh, Data Quality, and semantic ...

Bombay, भारत

  • Full-time
Leadership data science role at Commvault in Bengaluru. Needs 8+ years and a https://jobeax.com/link/wOcGjnRrrRFUZzB4, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Platform Architecture & Engineering - Design and implement secure, scalable platform services for Databricks, Azure Data Lake, Microsoft ...

Bangalore, भारत