Vacancy description
Vision Excel Career Solutions
AWS Data Architect - Python/Apache Airflow in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : AWS Data Architect Job Description :Candidate should possess a deep understanding of big data technologies, cloud services, and data architecture, with a proven track record of leading data-driven projects to successful https://jobeax.com/link/CEKJnNMNtDL19sum Responsibilities :- Lead a team of data engineers, providing technical guidance and mentorship. - Develop and execute a strategic roadmap for data processing, storage, and analytics in alignment with organizational goals.- Design, implement, and maintain robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes.- Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.- Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.- Oversee the integration of diverse systems and data sources through AppFlow, APIs, and other integration tools, ensuring seamless data exchange and connectivity.- Lead the development of data warehousing solutions, applying best practices in data modelling to support efficient data storage, retrieval, and analysis.- Continuously monitor, optimize, and troubleshoot data pipelines and infrastructure, ensuring optimal performance and scalability.- Ensure adherence to data governance, privacy, and security policies, implementing measures to protect sensitive data and comply with regulatory https://jobeax.com/link/COQih4IcZKKIeDR1 :- Bachelor's or master's degree in computer science, Engineering, or a related field.- 8-10 years of experience in data engineering, with at least 3 years in a leadership role.- Proficient in Python programming and experience with Airflow for workflow management.- Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics (S3, Glue, EMR, etc.).- Experience with real-time streaming technologies like Kafka, SQS, and Event Bridge.- Solid understanding of API based integrations and familiarity with integration tools such as AppFlow.- Deep knowledge of data warehousing concepts, data modelling techniques, and experience in implementing largescale data warehousing solutions.- Demonstrated ability to lead and mentor technical teams, with excellent communication and project management skills. (ref:hirist.tech)
Similar vacancies
Data Eminence
... understanding of SQL and relational databases - Basic understanding of statistics and data analysis techniques - Familiarity with Power BI, Tableau, or similar data visualization tools - Basic knowledge of data cleaning and data preparation - Familiarity with Python and libraries such as Pandas or NumPy is a plus - Understanding ...
India, India
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
India, Pune
Urban Company
... influencing metric variations Build Feature Store for Data Science implementations Overall experience of 0-2 yrs. in Advanced Analytics/ Business Intelligence/Data Warehousing Strong Background in Data Transformation Skills – SQL (Mandatory) & Python . Able to understand and align to long term vision of team A phenomenal ...
India, Gurugram
Axtria - Ingenious Insights
... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...
India, Gurugram
... stakeholders to ensure alignment with project objectives. Develop and optimize Python-based data science solutions using public datasets. Create well-documented Python code using Jupyter notebooks. Bachelor's/Master's degree in Engineering, Computer Science, or equivalent experience. Knowledge of Python programming for data ...
India, India
iConsultera
... Mathematics, Computer Science, Economics, or related field Technical Skills: Strong knowledge of SQL Experience with Excel / Google Sheets (Advanced) Proficiency in Python or R Experience with Power BI / Tableau / Looker Understanding of statistics and data modeling Basic knowledge of databases and data warehousing Soft Skills: ...
India, India
Weekday AI
... communication and stakeholder-management skills with the ability to explain complex data insights clearly. - Tableau certification such as Tableau Certified Data Analyst or Tableau Desktop Specialist will be an advantage. - Experience with Python or R for statistical analysis, data processing, or integrating analytical ...
India, Bengaluru
Axtria - Ingenious Insights
... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...
India, Noida
Neutrino Advisory, an Inc 5000 Company
... documentation. Experience with Snowflake . Experience with Azure data technologies , including Azure Data Factory, Synapse, Databricks, or Fabric. Experience with AWS Step Functions, Airflow/MWAA , or similar orchestration tools. Familiarity with data governance, metadata management, and data quality practices. AWS certifications. ...
India, India
Axtria - Ingenious Insights
... reliability.- Translate business use cases into scalable AI solution https://jobeax.com/link/BsfCGg64DtWZFq1U Qualifications :- 8+ years of experience in cloud architecture.- 3+ years designing AI/ML systems on AWS.- Hands-on experience with Amazon Bedrock, SageMaker, and vector databases.- Strong Python programming skills ...
India, Noida
EDMO Distributors
10k
... backend services using https://jobeax.com/link/JSd7UYCSg572jJDY, TypeScript, and NestJS. System Design: Design and implement both RESTful APIs and Event-Driven Architectures to support high-scale operations. Data Strategy: Optimize data persistence strategies using a mix of PostgreSQL for relational integrity and MongoDB for ...
India, Pune
Honeywell Technology Solutions Lab
... Ecosystem: Experience with Apache Spark (PySpark) and the Hadoop Ecosystem (HDFS, Hive, MapReduce) for handling, transforming, and querying large-scale distributed datasets. Cloud Architecture: Experience building and deploying scalable machine learning applications on major cloud platforms (AWS, Azure, or GCP). Core Mathematics ...
India, Bengaluru
PayPay India
... ability to design, build, and operate Data Lakes or Data Warehouses. Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect). Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell). Strong command of at least one primary language (Scala, Python, etc.) and SQL. Experience with data catalog and metadata ...
India, Gurugram
Ethos Life
... stack, we'd like to talk to you. Duties and Responsibilities: - Build and operate internal data platforms, services, and distributed workflow systems (Temporal, Airflow) that the rest of the company's data stack runs on. - Write and maintain internal Python libraries (including shared Airflow operators and frameworks) consumed ...
India, Bengaluru
ganit inc.
... Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Expertise in on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience ...
India, Bengaluru
$11 USD
... using languages like Go, Rust, or Python. Constantly challenge the data-stack status quo. Focus on building lightweight, cost-effective, and highly performant data systems, selecting tools based on architectural suitability rather than industry hype. Optimize data storage layouts, partitioning schemes, and query mechanics ...
India, Bengaluru
Dun & Bradstreet
... of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted environments and cloud platforms such as AWS, Azure, or similar (preferred). - Ability to work independently ...
India, Rāniganj
Diligent Corporation
700k
... experienced engineers across the development lifecycle. Design and build scalable backend services, REST APIs, integrations, and reusable software components using Python and, where relevant TypeScript. Develop data ingestion, transformation, service-to-service communication, and automation capabilities that support reliable product ...
India, Bengaluru
monk's hill ventures
... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...
India, Bengaluru
wowJobs
... practices across data engineering https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack:- Python, PySpark, SQL, AWS Glue, AWS Glue Data Catalog, AWS Lambda, Amazon S3, AWS Step Functions, Amazon EventBridge, Amazon https://jobeax.com/link/TvfOgTReNTFVgNXo Skills:- Experience working with AWS Data Lake architectures.- Knowledge of ...
India, Pune
India, Hyderabad