AWS Data Architect - Python/Apache Airflow in Hyderabad,… - Jobeax
Vacancy description
AWS Data Architect - Python/Apache Airflow in Hyderabad, India
Vision Excel Career Solutions
AWS Data Architect - Python/Apache Airflow in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : AWS Data Architect Job Description :Candidate should possess a deep understanding of big data technologies, cloud services, and data architecture, with a proven track record of leading data-driven projects to successful https://jobeax.com/link/CEKJnNMNtDL19sum Responsibilities :- Lead a team of data engineers, providing technical guidance and mentorship. - Develop and execute a strategic roadmap for data processing, storage, and analytics in alignment with organizational goals.- Design, implement, and maintain robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes.- Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.- Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.- Oversee the integration of diverse systems and data sources through AppFlow, APIs, and other integration tools, ensuring seamless data exchange and connectivity.- Lead the development of data warehousing solutions, applying best practices in data modelling to support efficient data storage, retrieval, and analysis.- Continuously monitor, optimize, and troubleshoot data pipelines and infrastructure, ensuring optimal performance and scalability.- Ensure adherence to data governance, privacy, and security policies, implementing measures to protect sensitive data and comply with regulatory https://jobeax.com/link/COQih4IcZKKIeDR1 :- Bachelor's or master's degree in computer science, Engineering, or a related field.- 8-10 years of experience in data engineering, with at least 3 years in a leadership role.- Proficient in Python programming and experience with Airflow for workflow management.- Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics (S3, Glue, EMR, etc.).- Experience with real-time streaming technologies like Kafka, SQS, and Event Bridge.- Solid understanding of API based integrations and familiarity with integration tools such as AppFlow.- Deep knowledge of data warehousing concepts, data modelling techniques, and experience in implementing largescale data warehousing solutions.- Demonstrated ability to lead and mentor technical teams, with excellent communication and project management skills. (ref:hirist.tech)
... workforce development and skills-based hiring, helping critical government systems scale while expanding access to meaningful, high-growth careers. The Solutions Architect owns the technical bridge between Fedstack's internal platform and the federal agencies we serve. Internally, you'll set the architecture for the candidate-facing ...
... problem-solving skills. Preferred Skills: Experience in the insurance industry or related domains. Familiarity with Agile and DevOps practices. Knowledge of data architecture and integration patterns. Certifications in enterprise architecture frameworks (TOGAF, Zachman, etc.). Education / Qualification: BE/ https://jobeax.com/link/2DENLGgQM7whDhaE ...
... threat resolution and better SOC efficiency. Design and implement microservices-based architectures Lead solutioning for cloud-based applications, primarily using AWS (EC2, RDS, EKS, S3, etc.). Develop and validate POCs to demonstrate architecture viability. understands and applies business models within the architecture function. ...
... platform Lead architecture initiatives across multiple product lines and engineering teams Partner with executive leadership and Chief Architects on enterprise architecture direction Architecture & Innovation Architect large-scale, mission-critical systems on AWS handling billions of transactions Establish architectural standards ...
... experience in designing and implementing security architecture, with proven lead experience in large-scale, complex environments. - Expertise in cloud security (AWS, Azure, GCP), network infrastructure, data protection, and zero-trust principles. - Familiarity with security and architecture standards & frameworks such as ...
... strategy & design across AWS / Azure / GCP — including infrastructure-as-code, serverless, containerization (Kubernetes), and multi-cloud deployments. - Drive data architecture encompassing data lakes, real-time analytics, ETL/ELT pipelines, and data platforms (e.g., Snowflake, Databricks, BigQuery) to power personalization, ...
... software projects Prior experience in a software consultancy or agency environment Deep knowledge of RAG systems, LLMOps, or agentic AI frameworks Certifications in AWS Solutions Architect, GCP Professional Architect, or similar Experience in regulated industries (FinTech, HealthTech, LegalTech) Competitive salary well above ...
... Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python / Java / Data Governance Drive ...
... scalable, and high-performance full-stack web applications using Python (FastAPI) on the backend and https://jobeax.com/link/6WcBICn0LM558SP0 on the frontend. Database Design & Management: Architect and optimize both relational ( SQL ) and non-relational ( NoSQL ) database schemas to handle complex data structures efficiently. ...
... architectures for batch, near real time, and event-driven use cases. - Define logical and physical architecture patterns using cloud-native platforms and modern data technologies. - Guide the development of scalable, secure, reliable, and cost-effective data solutions using tools such as Databricks, dbt, SQL, Python or Scala, ...
... covering quality, hallucination, reliability, latency, cost, and model/data drift.- Develop production-grade ML services, APIs, and inference systems using Python, FastAPI/Django, and LangGraph or similar frameworks.- Build and operate AI infrastructure using AWS, Hetzner, Docker, Terraform, and Jenkins.- Support self-hosted ...
Experience : 7+ years of experience in Data Engineering, Data Quality, or Data Governance. 3+ years of experience working on AWS Data Platforms. Strong hands-on expertise in: - Python - SQL - Data Quality Engineering - Data Profiling - Data Validation Frameworks - Experience building AI-powered data quality and governance ...
... to engage with non-technical business leaders to understand their data needs and translate them into accurate, visual reports. Desired Skills (Bonus Points) Tableau Certification (e.g., Tableau CertifiedData Analyst, Desktop Specialist). Experience with Python or R for advanced statistical analysis feeding into Tableau
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
... understanding of SQL and relational databases - Basic understanding of statistics and data analysis techniques - Familiarity with Power BI, Tableau, or similar data visualization tools - Basic knowledge of data cleaning and data preparation - Familiarity with Python and libraries such as Pandas or NumPy is a plus - Understanding ...
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
... influencing metric variations Build Feature Store for Data Science implementations Overall experience of 0-2 yrs. in Advanced Analytics/ Business Intelligence/Data Warehousing Strong Background in Data Transformation Skills – SQL (Mandatory) & Python . Able to understand and align to long term vision of team A phenomenal ...
... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...