Senior Data Engineer - Python/AWS in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate should have hands-on experience with ETL/ELT pipelines, workflow orchestration, AWS cloud services, data visualization, distributed architectures, and modern data engineering https://jobeax.com/link/TtkK7BHPbancvnFq Responsibilities:- Design, develop, and maintain scalable ETL/ELT data pipelines.- Build and manage distributed and event-driven architectures for large-scale data processing.- Develop backend services and data infrastructure using Python.- Implement DAG-based workflow orchestration using Airflow, Prefect, or Dagster.- Work with AWS services including Lambda, S3, ECS/EKS, SQS, and CloudWatch.- Design and optimize data models and schema structures.- Develop analytics dashboards and reporting solutions using Amazon QuickSight.- Implement CI/CD pipelines and Infrastructure as Code (IaC).- Monitor and maintain data platforms using observability and monitoring tools.- Collaborate with Data Scientists, ML Engineers, and Backend Developers.- Support AWS cloud migration and modernization https://jobeax.com/link/CTgddHUNWTroYPch Skills:- Strong proficiency in Python.- Experience with Docker and Kubernetes.- Strong understanding of distributed and event-driven architectures.- Hands-on experience building ETL/ELT pipelines.- Strong knowledge of data modeling and schema design.- Experience with Airflow, Prefect, or Dagster.- Hands-on experience with AWS Lambda, S3, ECS/EKS, SQS, and CloudWatch.- Experience with CI/CD and Infrastructure as Code (IaC).- Hands-on experience with Amazon QuickSight for dashboards, reporting, and https://jobeax.com/link/RuPwATTO2ckHqbM4 to Have:- AWS Application Migration Service (MGN/AMC) or similar migration technologies.- Logstash or other data ingestion frameworks.- OpenSearch / Elasticsearch.- Kafka / Kinesis and streaming technologies.- Prometheus, Grafana, or ELK Stack.- MLOps lifecycle knowledge.- Vector databases and embedding pipelines.- Large-scale indexing and search optimization.- RAG, Natural Language Search, GenAI, knowledge graphs, prompt engineering, and embedding models.- Knowledge of Golang, Rust, Java, C/C++, or other compiled languages. (ref:hirist.tech)
... governance. Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other ...
Hiring : Senior Data Engineer | 6+ https://jobeax.com/link/elpmNuUlUrtRmNOJ : https://jobeax.com/link/TEtw0SgP3UR1RgAh : Senior Data https://jobeax.com/link/gTHUyXDKJ42uWexF are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, ...
Neutrino Advisory is looking for an experienced Senior Data Engineer with strong hands-on experience building and supporting data solutions on AWS . The role requires solid experience with Amazon Redshift, S3, AWS Glue, Amazon AppFlow, Lambda, and SQL . You will work on data ingestion, transformation, data pipelines, data ...
... has worked with cloud-based data warehousing solutions (e.g., Fabric,Snowflake, Redshift, Databricks) and principles - Proficient in SQL and Apache Spark / Python programming languages. - Experience with cloud platforms like Azure. - Experience in data pipelines and ETL/ELT tools, including AWS Glue/Azure Data Factory/ ...
... knowledge of PostgreSQL. Experience developing REST APIs using FastAPI. Hands-on experience with Splink for entity resolution and record linkage. Strong SQL and Python programming skills. Experience with ETL/ELT pipeline development. Familiarity with cloud platforms like AWS, Azure, or GCP. Knowledge of data engineering best ...
Data Engineer – Python & Pyspark (AWS) Exp: 6+ yrs Location : Chennai Client Place Guindy Work Mode : All 5 days Role Overview We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You ...
... processes, optimising data delivery and re-designing infrastructure for greater scalability.- Collaborate with stakeholders to ensure seamless integration of data with internal data marts, enhancing advanced reporting.- Setup and maintain data ingestion, streaming, scheduling, and job monitoring automation using AWS services.- ...
Position: Senior Data Engineer Location: Pune Job Responsibilities Design, develop, and maintain scalable data pipelines using AWS services. Design and implement scalable, secure, and resilient MLOps architecture across cloud and on-prem environments Define best practices for model lifecycle management, including versioning, ...
... least one certification • Databricks Certified Data Engineer Associate OR Databricks Certified Data Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud ...
... operations at ELGi. Data Engineering & Architecture Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks for ingestion, transformation, and orchestration. Build Spark, SQL, and Python workflows in Databricks. Optimize compute, storage, and ...
... computer science, Engineering, or a related field.- 8-10 years of experience in data engineering, with at least 3 years in a leadership role.- Proficient in Python programming and experience with Airflow for workflow management.- Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... data https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack & Requirements : - Strong proficiency in Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts ...