Vacancy description
Vision Excel Career Solutions
AWS Data Architect - Python/Apache Airflow in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : AWS Data Architect Job Description :Candidate should possess a deep understanding of big data technologies, cloud services, and data architecture, with a proven track record of leading data-driven projects to successful https://jobeax.com/link/CEKJnNMNtDL19sum Responsibilities :- Lead a team of data engineers, providing technical guidance and mentorship. - Develop and execute a strategic roadmap for data processing, storage, and analytics in alignment with organizational goals.- Design, implement, and maintain robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes.- Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.- Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.- Oversee the integration of diverse systems and data sources through AppFlow, APIs, and other integration tools, ensuring seamless data exchange and connectivity.- Lead the development of data warehousing solutions, applying best practices in data modelling to support efficient data storage, retrieval, and analysis.- Continuously monitor, optimize, and troubleshoot data pipelines and infrastructure, ensuring optimal performance and scalability.- Ensure adherence to data governance, privacy, and security policies, implementing measures to protect sensitive data and comply with regulatory https://jobeax.com/link/COQih4IcZKKIeDR1 :- Bachelor's or master's degree in computer science, Engineering, or a related field.- 8-10 years of experience in data engineering, with at least 3 years in a leadership role.- Proficient in Python programming and experience with Airflow for workflow management.- Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics (S3, Glue, EMR, etc.).- Experience with real-time streaming technologies like Kafka, SQS, and Event Bridge.- Solid understanding of API based integrations and familiarity with integration tools such as AppFlow.- Deep knowledge of data warehousing concepts, data modelling techniques, and experience in implementing largescale data warehousing solutions.- Demonstrated ability to lead and mentor technical teams, with excellent communication and project management skills. (ref:hirist.tech)
Similar vacancies
$11 USD
... using languages like Go, Rust, or Python. Constantly challenge the data-stack status quo. Focus on building lightweight, cost-effective, and highly performant data systems, selecting tools based on architectural suitability rather than industry hype. Optimize data storage layouts, partitioning schemes, and query mechanics ...
India, Bengaluru
Dun & Bradstreet
... of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted environments and cloud platforms such as AWS, Azure, or similar (preferred). - Ability to work independently ...
India, Rāniganj
Diligent Corporation
700k
... experienced engineers across the development lifecycle. Design and build scalable backend services, REST APIs, integrations, and reusable software components using Python and, where relevant TypeScript. Develop data ingestion, transformation, service-to-service communication, and automation capabilities that support reliable product ...
India, Bengaluru
monk's hill ventures
... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...
India, Bengaluru
wowJobs
... practices across data engineering https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack:- Python, PySpark, SQL, AWS Glue, AWS Glue Data Catalog, AWS Lambda, Amazon S3, AWS Step Functions, Amazon EventBridge, Amazon https://jobeax.com/link/TvfOgTReNTFVgNXo Skills:- Experience working with AWS Data Lake architectures.- Knowledge of ...
India, Pune
R Systems
... and Delta Live Tables - Advanced skills in Python and SQL - Experience with Unity Catalog, cluster administration, and at least one major cloud platform (Azure, AWS, or GCP) - Solid understanding of data warehousing and dimensional modeling Databricks Certified Data Engineer (Associate or Professional) Cloud data engineering ...
India
Teamware Solutions
... least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse ...
India, Bengaluru
Auriga IT
... working with large datasets, building data pipelines, and writing efficient, scalable Python code. Key Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, ...
India, Jaipur
blucursor infotech pvt ltd
... Experience with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Strong understanding of Linux system administration. Experience working in cloud environments (AWS, Azure, or GCP). Basic scripting skills in Python, Bash, or similar languages. Exposure to Docker and basic Kubernetes concepts. bluCursor is a technology services ...
India, Indore
Sonata Software Limited
$1.2 USD
... Serve as a trusted consultant for customers, providing expert guidance and https://jobeax.com/link/c21jIsX1adt6pb90 :- 15+ years of experience in Enterprise Architecture, with a focus on cloud-native solutions on AWS.- Proven experience in designing, architecting, building, and modernizing React JS/Python based large platforms ...
India, Hyderabad
IMerit Technology
... environments (preferably AWS). Document architecture, data flow, and support runbooks; continuously improve platform performance and resilience. Integrate with customer data platforms and pipelines, including bespoke data frameworks. 4–8 years of experience in data engineering or backend development in data-intensive environments. ...
India, Bengaluru
... integrations tailored to meet the unique needs of each business. Join us to shape the future of customer care with cutting-edge AI technology. We are seeking a skilled Python Backend Engineer to join our dynamic team in Pune. In this role, you will design, develop, and maintain efficient, reusable, and high-performance Python-based ...
India, Pune
mindbrain
... entity resolution and record linkage. Strong SQL and Python programming skills. Experience with ETL/ELT pipeline development. Familiarity with cloud platforms like AWS, Azure, or GCP. Knowledge of data engineering best practices and scalable architectures. Experience with Apache Spark or PySpark. Knowledge of Docker, Kubernetes, ...
India, India
Straive
Roles and Responsibilities Architect and maintain enterprise-grade ELT and ETL data pipelines using Python, PySpark, Kafka, and Databricks to manage large-scale risk data. Build and deploy GenAI agents utilizing Google ADK, Google Flash 2.5+ LLMs, and Model Context Protocol (MCP) integrated with Human-in-the-Loop workflows. ...
India, Pune
Sonata Software Limited
... Kubernetes.- Infrastructure Automation & Configuration Management : Terraform, Ansible, CloudFormation.- CI/CD Platforms : GitLab CI/CD.- Observability Tools : DataDog or Dynatrace.- MLOps Platforms & Workflow Orchestration : MLflow, Airflow, AWS SageMaker.- Data & API Integration : SQL, REST APIs.- Cloud Security & Access ...
India, Bengaluru
GFL Recruitment Private Limited/Zigsaw
... engineers.- Handle production incidents with urgency and https://jobeax.com/link/ePmTJnx8CZmAJ7AG Skills : Strong Expertise In : - Linux Server Administration, AWS / GCP / Azure, Docker, Kubernetes, Jenkins / GitHub Actions / GitLab CI, Nginx / Apache, Load Balancers, Networking & Security, Monitoring Tools (Prometheus, ...
India, Ahmedabad
Gravitas Technology Private Limited
... System Design : Architect scalable, high-availability solutions for investment management workflows, making authoritative decisions on microservices vs. monolith, data consistency models, and cloud-native patterns.- Tech Roadmap : Define the long-term technical vision, ensuring the platform evolves from Cloud (AWS) server architecture ...
India, Mumbai
... related field. Nice to Have - Familiarity with dbt Mesh concepts (cross-project references, data contracts) or multi-project dbt architectures. - Exposure to data ingestion tools such as Fivetran, Airbyte, or AWS Glue for loading source data into Snowflake. - Experience working with business application data (e.g., Salesforce, ...
India, Pune
KPI PARTNERS INDIA PRIVATE LIMITED
... deploying complex data architectures within Microsoft Fabric and the broader Azure ecosystem.- Advanced proficiency in Python and SQL for building sophisticated data processing pipelines and complex analytical models.- Strong background in data engineering principles, including ETL/ELT design, data modeling, and performance ...
India, Pune
... learning, statistical modeling, and process-mining algorithms to large, multi-source enterprise datasets. - Strong programming proficiency in Python, SQL, and data-modeling techniques for event data. - Experience in process data model design, development, and deployment, including creation of reusable data schemas and pipelines ...
India, Chennai
India, Hyderabad