Kafka Architect - Event Streaming in Hyderabad, India
XFactor Talent
India, Hyderabad
Kafka Architect - Event Streaming in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
About the Role :We are seeking an Expert Kafka professional with overall experience of 12+ Years. This senior role requires a technical professional who can design highly available, scalable, and secure Kafka ecosystems, establish streaming best practices, and drive the adoption of event-driven patterns across the https://jobeax.com/link/NJQDySrUeub5PMgS & Responsibilities :- Architect and design enterprise-scale Confluent Kafka infrastructure supporting high-throughput, low-latency event streaming requirements.- Design Kafka cluster topologies including multi-region, multi-datacenter, and hybrid cloud deployments.- Architect Confluent Platform components: Confluent Server, ZooKeeper/KRaft, Schema Registry, Kafka Connect, ksqlDB, Confluent Control Center.- Design end-to-end event streaming solutions using Kafka for real-time data integration and event-driven architectures.- Optimize Kafka cluster performance: throughput tuning, latency reduction, and resource utilization.- Architect comprehensive Kafka security models including authentication, authorization, and encryption.- Design monitoring and observability solutions for Kafka infrastructure using Confluent Control Center, Prometheus, Grafana.- Establish Kafka development standards, coding guidelines, and best practices for engineering teams.- Collaborate with data engineers, software engineers, and architects to design streaming solutions.- Research and evaluate emerging technologies in the event streaming and real-time analytics space. (ref:hirist.tech)
... Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.- Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.- Oversee the integration of diverse systems and data sources through AppFlow, ...
... and/or FastAPI; experience with https://jobeax.com/link/JSd7UYCSg572jJDY is a plus. - Proven experience designing and building REST APIs and microservices architectures. - Hands-on experience with Kafka or similar message brokers/event streaming platforms. - Solid understanding of both relational and NoSQL databases - ...
... non-relational database schemas, complex indexing strategies, data partitioning models, and archival frameworks. - Scale event-driven architectures utilizing Apache Kafka or similar messaging systems to manage reliable real-time data streaming and asynchronous decoupling. - Optimize high-throughput caching architectures (using ...
... fault-processing capabilities within our AIOps platform. You own module delivery end-to-end — from low-level design through production support — and work with platform architects and PMs to ship high-impact features. Tech Stack Java Spring Boot Apache Kafka Kafka Streams Kafka Connect Apache Spark Responsibilities Module Ownership ...
... improvement of search systems hosted on Elastic Cloud and Azure infrastructure. - Ensure seamless integration of search with data pipelines, caching layers, and event-driven systems leveraging Redis and Kafka. - Collaborate with engineering managers to guide, influence, and uplift the overall technical delivery and productivity ...
... GitHub Actions, AWS CodePipeline, Azure DevOps, or GitLab CI - Strong engineering mindset — you build it, you own it, you operate it Nice-to-Have Experience with Kafka, Kinesis, or Event Hubs for event streaming Familiarity with dbt for ELT and data testing Great Expectations or Deequ for data quality Docker / Kubernetes for ...
... engineering team building our modern payments platform, currently powering corporate payments with plans to expand across all lines of business. You'll work on an event-driven, microservices architecture in Kubernetes, using Terraform, Kafka, and CI/CD to enable true continuous delivery. You'll embrace AI-assisted engineering ...
... design and rapid product delivery. You will be responsible for building the backbone of our platform, moving seamlessly between high-performance NestJS services, event-driven architectures with Kafka, and scalable cloud infrastructure. Architect & Build: Lead the development of scalable backend services using https://jobeax.com/link/JSd7UYCSg572jJDY, ...
... https://jobeax.com/link/TtkK7BHPbancvnFq Responsibilities:- Design, develop, and maintain scalable ETL/ELT data pipelines.- Build and manage distributed and event-driven architectures for large-scale data processing.- Develop backend services and data infrastructure using Python.- Implement DAG-based workflow orchestration ...
... real-time analytics and predictive insights - Scalable microservices architecture supporting enterprise clients - High-performance APIs for real-time data streaming and visualization Key Responsibilities Backend Development Design and implement real-time data pipeline using Apache Kafka and Redis Build microservices architecture ...
... Oracle, or MySQL. NoSQL Databases: Familiarity with NoSQL databases like MongoDB, Cassandra, or Redis is highly desirable. Experience with message brokers and event-streaming platforms such as Apache Kafka, RabbitMQ, or ActiveMQ. Strong verbal and written communication skills, with the ability to explain technical concepts ...
... microservices architecture, enterprise integration patterns, and scalable infrastructure design.- Hands-on experience with Java, Spring Boot, RESTful web services, and event-driven integration using Kafka.- Strong relational database skills across DB2, SQL Server, and Oracle, including data modeling for high-volume transactional ...
Company Description SortMyScene is India's fastest growing event ticketing platform. Operating in more than 100 cities across 25 states, SortMyScene has become a prominent platform for music enthusiasts. The company is dedicated to enhancing event experiences by connecting fans with the best events and music festivals across ...
... candidate will have strong hands-on experience with AWS data services and distributed data processing, along with a solid understanding of data modelling, streaming architectures, data quality, and pipeline optimisation. Requirements KEY RESPONSIBILITIES Design, develop, and maintain end-to-end data pipelines for high-volume ...