brillio-2
Principal Data Engineer-R01570250
Hyderabad, भारत
Vacancy description
nxtwave disruptive technologies private limited
Bangalore, भारत
Job Overview:We are seeking a seasoned Principal Data Engineer with 10+ years of experience to design, build, and scale our next-generation fintech data platform. This is a senior technical leadership role where you will own the architectural strategy for high-performance data lakes, real-time distributed data pipelines, and scalable warehouse https://jobeax.com/link/KUraTLaggap5UbBB Responsibilities:- Pipeline Architecture: Design, build, and maintain highly optimal real-time and batch data pipeline architectures using modern Big Data technologies.- Warehousing & Lakes: Develop and maintain robust, high-performance data warehouses and data lakes on AWS/GCP to guarantee safe writes, efficient retrieval, and schema evolution.- Data Modeling & Taxonomy: Author complex SQL queries, design logical/conceptual data models, and create a centralized metadata taxonomy/data dictionary for business stakeholders.- Stream Processing: Implement real-time data processing pipelines within a microservices architecture using stream tools like Spark-Streaming or Flink.- Process Automation & DevOps: Advocate for and implement engineering best practices across the team, driving automated tracking, CI/CD deployment logic, TDD workflows, and performance optimization.- API Integrations: Build data acquisition frameworks to cleanly ingest external datasets through secure enterprise APIs and https://jobeax.com/link/mCVzuWMc8OFo16u3 Stack & Qualifications:- 10+ years of direct, hands-on software development experience within a dedicated Data Engineer or Data Architect role.- Comprehensive expertise utilizing big data infrastructure ecosystems: HDFS, S3, Spark, Flink, Hive, Hbase, Kafka, or Kinesis.- Advanced proficiency in relational SQL querying along with NoSQL database management systems (Elasticsearch, Cassandra, MongoDB).- Solid command over workflow orchestration tools (Airflow, Luigi, Azkaban) and object-oriented/functional programming scripting languages (Java, Scala, Python).- Prior experience working within a dynamic fintech or high-volume transactional platform environment is highly preferred. (ref:hirist.tech)
Similar vacancies
brillio-2
Hyderabad, भारत
Hyderabad, भारत
Pune, भारत
techno-comp computer services pvt. ltd.
Hyderabad, भारत
Sembridge
भारत
Hiresquad Resources
Chennai, भारत
Bangalore, भारत
Tiger Analytics
Chennai, भारत
Development
Hyderabad, भारत
Eucloid Data Solutions Pvt Ltd
Gurgaon, भारत