HG Insights
Principal Data Engineer
- Contract
Pune, भारत
Vacancy description
nxtwave disruptive technologies private limited
Bangalore, भारत
Job Overview:We are seeking a seasoned Principal Data Engineer with 10+ years of experience to design, build, and scale our next-generation fintech data platform. This is a senior technical leadership role where you will own the architectural strategy for high-performance data lakes, real-time distributed data pipelines, and scalable warehouse https://jobeax.com/link/KUraTLaggap5UbBB Responsibilities:- Pipeline Architecture: Design, build, and maintain highly optimal real-time and batch data pipeline architectures using modern Big Data technologies.- Warehousing & Lakes: Develop and maintain robust, high-performance data warehouses and data lakes on AWS/GCP to guarantee safe writes, efficient retrieval, and schema evolution.- Data Modeling & Taxonomy: Author complex SQL queries, design logical/conceptual data models, and create a centralized metadata taxonomy/data dictionary for business stakeholders.- Stream Processing: Implement real-time data processing pipelines within a microservices architecture using stream tools like Spark-Streaming or Flink.- Process Automation & DevOps: Advocate for and implement engineering best practices across the team, driving automated tracking, CI/CD deployment logic, TDD workflows, and performance optimization.- API Integrations: Build data acquisition frameworks to cleanly ingest external datasets through secure enterprise APIs and https://jobeax.com/link/mCVzuWMc8OFo16u3 Stack & Qualifications:- 10+ years of direct, hands-on software development experience within a dedicated Data Engineer or Data Architect role.- Comprehensive expertise utilizing big data infrastructure ecosystems: HDFS, S3, Spark, Flink, Hive, Hbase, Kafka, or Kinesis.- Advanced proficiency in relational SQL querying along with NoSQL database management systems (Elasticsearch, Cassandra, MongoDB).- Solid command over workflow orchestration tools (Airflow, Luigi, Azkaban) and object-oriented/functional programming scripting languages (Java, Scala, Python).- Prior experience working within a dynamic fintech or high-volume transactional platform environment is highly preferred. (ref:hirist.tech)
Similar vacancies
HG Insights
Pune, भारत
Commvault
Bangalore, भारत
nxtwave disruptive technologies private limited
Hyderabad, भारत
भारत
Bangalore, भारत
Core Edge Solutions LLP
Bangalore, भारत
iSOCRATES MADTech Pvt Ltd
Bangalore, भारत
The Nielsen Company
Bangalore, भारत
nxtwave disruptive technologies private limited
Pune, भारत
Bangalore, भारत
Rs 3.2 - 4.2 lakhs p.a.
भारत