Vacancy description
Vision Excel Career Solutions
AWS Data Architect - Python/Apache Airflow in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : AWS Data Architect Job Description :Candidate should possess a deep understanding of big data technologies, cloud services, and data architecture, with a proven track record of leading data-driven projects to successful https://jobeax.com/link/CEKJnNMNtDL19sum Responsibilities :- Lead a team of data engineers, providing technical guidance and mentorship. - Develop and execute a strategic roadmap for data processing, storage, and analytics in alignment with organizational goals.- Design, implement, and maintain robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes.- Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.- Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.- Oversee the integration of diverse systems and data sources through AppFlow, APIs, and other integration tools, ensuring seamless data exchange and connectivity.- Lead the development of data warehousing solutions, applying best practices in data modelling to support efficient data storage, retrieval, and analysis.- Continuously monitor, optimize, and troubleshoot data pipelines and infrastructure, ensuring optimal performance and scalability.- Ensure adherence to data governance, privacy, and security policies, implementing measures to protect sensitive data and comply with regulatory https://jobeax.com/link/COQih4IcZKKIeDR1 :- Bachelor's or master's degree in computer science, Engineering, or a related field.- 8-10 years of experience in data engineering, with at least 3 years in a leadership role.- Proficient in Python programming and experience with Airflow for workflow management.- Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics (S3, Glue, EMR, etc.).- Experience with real-time streaming technologies like Kafka, SQS, and Event Bridge.- Solid understanding of API based integrations and familiarity with integration tools such as AppFlow.- Deep knowledge of data warehousing concepts, data modelling techniques, and experience in implementing largescale data warehousing solutions.- Demonstrated ability to lead and mentor technical teams, with excellent communication and project management skills. (ref:hirist.tech)
Similar vacancies
HighRadius
... provides to our customers. Experience Range: 11 to 15 Years Role:Java Architect Technology Stack: Java, Struts, Hibernate, springboot, MySQL, ExtJS, Elastic Search, AWS Infra, Cloud Security, HLD, LLD, Application Design, Performance, Scalability Responsibilities Technical Architect defines and owns the technical architecture ...
India, Rāniganj
Globallogic India
... technologies including REST, SOAP, and WSDL Boomi platform architecture Boomi Atom Clouds, Local Atoms, and Molecules SME for client contact and good in Design and Architecture decisions. Analyze Integration requirements perform gap analysis. Analyze source and target system data and map transformations meeting the requirement. ...
India, Bengaluru
letzbizz
... RDS, Redshift Experience with stream-processing systems: Experience with object-oriented/object-function scripting languages: Python, Java, etc. Knowledge of data pipelines and workflow management tools like Airflow Hiring #SeniorDataEngineer #BigData #ChennaiJobs #ETL #AWS #SQL #DataPipelines #DataEngineering #Python #Java ...
India, Chennai
JMAN Group
... has worked with cloud-based data warehousing solutions (e.g., Fabric,Snowflake, Redshift, Databricks) and principles - Proficient in SQL and Apache Spark / Python programming languages. - Experience with cloud platforms like Azure. - Experience in data pipelines and ETL/ELT tools, including AWS Glue/Azure Data Factory/ ...
India, Mannady
altysys
... (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) Skills: - Kubernetes exposure - Experience with multiple cloud platforms (AWS, Azure, GCP)
India, Gurugram
Augusta Infotech
... the Python libraries and frameworks such as Pandas, Requests, Flask, FastAPI, and web development concepts.- Experience with RESTful APIs and microservices architecture.- Deep understanding of AWS cloud services such as EC2, S3, Lambda, RDS, and experience in deploying and managing applications on AWS.- Understanding of ...
India, Gurugram
applied systems india
... in building and maintaining a scalable Data Warehouse in a cloud-based data platform, preferably in Google's BigQuery. - Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery etc. - Proficiency in SQL, DBT, Python (Apache Airflow, Composer) and hands-on experience with ETL ...
India, Bengaluru
Valuelabs
... such as Airflow and AWS Step Functions. Experience with NoSQL databases and data stores. Understanding of SDLC, CI/CD, code reviews, testing, and software architecture best practices. Preferred Candidate Profile: A hands-on Data Engineer with strong AWS data platform experience, capable of delivering scalable, reliable, ...
India, Rāniganj
Appsierra Group
... involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows ...
India, Pune
HighRadius
... automated failover policies, and disaster recovery readiness. Data & Integration Architecture: - Design robust relational (PostgreSQL/MySQL) and non-relational database schemas, complex indexing strategies, data partitioning models, and archival frameworks. - Scale event-driven architectures utilizing Apache Kafka or similar ...
India, Hyderabad
USEReady Technology Pvt. Ltd.
... https://jobeax.com/link/EnCWxVsrOA3PLZCF Data & AI Architecture : - Design modern AWS-native data platforms including ingestion, storage, transformation, governance, semantic layer, and data products.- Architect enterprise data products using domain-driven design principles.- Establish architecture standards for performance, scalability, resiliency, ...
India, Pune
TalentXO
... features and data contracts. Build and ship models to: Enhance customer experiences and personalization Boost revenue via pricing/discount optimization Detect and block fraud/risk in real time Collaborate with Engineering to productionize via APIs/CI/CD/Docker on AWS. Build monitoring for model/data drift and business KPIs
India, Mumbai
Rs 7.5 - 34.5 lakhs p.a.
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
India, Bengaluru
NETCORE CLOUD PRIVATE LIMITED
... Databases like Cassandra, MongoDB, Aerospike, Clickhouse, BigQuery, Snowflake, Druid, Vector & Graph Databases like Apache Neo4j, TigerGraph.- Experience in building Data Platforms/Pipelines: Databricks, Apache Iceberg, Apache Hudi, Apache Kafka, Apache Spark, Apache Flink, Apache Trino, Apache Polaris/Project Nessie, Alluxio.- ...
India, Bengaluru
fedstack
... workforce development and skills-based hiring, helping critical government systems scale while expanding access to meaningful, high-growth careers. The Solutions Architect owns the technical bridge between Fedstack's internal platform and the federal agencies we serve. Internally, you'll set the architecture for the candidate-facing ...
India, India
Coforge
... problem-solving skills. Preferred Skills: Experience in the insurance industry or related domains. Familiarity with Agile and DevOps practices. Knowledge of data architecture and integration patterns. Certifications in enterprise architecture frameworks (TOGAF, Zachman, etc.). Education / Qualification: BE/ https://jobeax.com/link/2DENLGgQM7whDhaE ...
India
... threat resolution and better SOC efficiency. Design and implement microservices-based architectures Lead solutioning for cloud-based applications, primarily using AWS (EC2, RDS, EKS, S3, etc.). Develop and validate POCs to demonstrate architecture viability. understands and applies business models within the architecture function. ...
India, Bengaluru
ACI Worldwide
6k
... platform Lead architecture initiatives across multiple product lines and engineering teams Partner with executive leadership and Chief Architects on enterprise architecture direction Architecture & Innovation Architect large-scale, mission-critical systems on AWS handling billions of transactions Establish architectural standards ...
India, Pune
... experience in designing and implementing security architecture, with proven lead experience in large-scale, complex environments. - Expertise in cloud security (AWS, Azure, GCP), network infrastructure, data protection, and zero-trust principles. - Familiarity with security and architecture standards & frameworks such as ...
India, Bengaluru
Tata Elxsi
... strategy & design across AWS / Azure / GCP — including infrastructure-as-code, serverless, containerization (Kubernetes), and multi-cloud deployments. - Drive data architecture encompassing data lakes, real-time analytics, ETL/ELT pipelines, and data platforms (e.g., Snowflake, Databricks, BigQuery) to power personalization, ...
India, Bengaluru
India, Hyderabad