Vacancy description
India, Bengaluru
Data Engineer - Python, AWS, SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Position Overview:We are looking for a Data Engineer with hands-on experience in Apache Airflow, Python, and Jupyter Notebook to build, orchestrate, and maintain robust data pipelines that power our analytics and business decisions. In this role, you will work closely with data teams to clean, transform, and move data reliably across our platforms while ensuring pipeline performance and data integrity at https://jobeax.com/link/AwOVwl2FkAY2iw53 Architecture:- Design, build, and maintain scalable ETL/ELT data pipelines using Apache Airflow and https://jobeax.com/link/9BZSgic8TwoqWitR & Workflow:- Schedule, monitor, optimize, and troubleshoot Airflow DAGs to ensure reliable, high-availability data https://jobeax.com/link/zruxWYQz3eqyaZpe Processing:- Perform data extraction, cleaning, transformation, and validation across structured and unstructured multi-source https://jobeax.com/link/sluZEnCJKJyUJkcP & Analysis:- Use Jupyter Notebook for exploratory data analysis, pipeline testing, data profiling, and rapid prototyping.Cross-Team Collaboration:- Partner with data analysts, data scientists, and product teams to translate business requirements into reliable data https://jobeax.com/link/slfm2H5M70Q62wJ5 & Performance:- Ensure high data quality, strict data integrity, and pipeline execution speed at scale.Documentation:- Maintain clean, clear documentation for all data pipelines, lineage, and operational https://jobeax.com/link/iF5NRBBcXKPJeYbp Qualifications:Experience:- 1 to 2 years of hands-on, production experience in data https://jobeax.com/link/lptHFLDlMUnekis0 Proficiency:- Strong proficiency in Python for data manipulation, ETL scripting, and https://jobeax.com/link/DH9RkYsfBywYaX8K Orchestration:- Working experience with Apache Airflow (DAG creation, task dependencies, custom operators, and scheduling).Prototyping Tools:- High comfort level working in Jupyter Notebook for data prototyping and interactive https://jobeax.com/link/zlk2beUnqej1rgqa Foundations:- Solid understanding of SQL, relational/non-relational databases, and data modeling https://jobeax.com/link/SKciAM5XjIOOw9Ja Qualifications:Education:- https://jobeax.com/link/2DENLGgQM7whDhaE / B.E. in Computer Science, Data Science, or a related field, preferably from a premier institution (NIT or IIT).Cloud Infrastructure:- Familiarity with major cloud environments (AWS, GCP, or Azure).Big Data Technologies:- Exposure to distributed computing frameworks like Apache Spark, streaming platforms like Kafka, or cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).Shift Timing:- 10:00 AM 7:00 PM IST (ref:hirist.
Similar vacancies
$11 USD
... solutions over bloated, off-the-shelf enterprise software. Strong programming fundamentals in systems-adjacent or highly performant languages ( Go, Rust, or Python ) alongside advanced mastery of SQL . IoT & Telematics Experience: Proven experience dealing with high-volume, time-series, or streaming telematics/IoT data. ...
India, Bengaluru
Dun & Bradstreet
... 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted environments and cloud platforms such as AWS, Azure, or similar (preferred). - Ability to work ...
India, Rāniganj
BlackBox
... Computer Science, IT, Data Science, Mathematics, or a related field (Recent graduates from batch [Year] are welcome). Python: Solid foundational knowledge of Python programming (data structures, loops, functions, basic libraries like Pandas). PostgreSQL (SQL): Basic understanding of relational databases, table design, and ...
India, Mumbai
PayPay India
... ability to design, build, and operate Data Lakes or Data Warehouses. Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect). Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell). Strong command of at least one primary language (Scala, Python, etc.) and SQL. Experience with data catalog and metadata ...
India, Gurugram
monk's hill ventures
... real-time decisioning. Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems. Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Comfortable with SQL and a transformation framework (e.g., Familiarity with ...
India, Bengaluru
Appsierra Group
... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...
India, Pune
Auriga IT
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
India, Jaipur
altysys
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
India, Gurugram
SHIMENTO INDIA LLP
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
India, Bengaluru
JP Morgan Chase & Co.
... (e.g., model/design summaries or operational checklists) before use, escalating when uncertain and following data handling requirements. Strong proficiency in data science and analytics tools: Python, R, SQL, Spark, and cloud data platforms (AWS, Azure, GCP). Experience with data visualization and reporting tools (e.g., ...
India, Bengaluru
... requirements Experience: 8+ years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: ...
India, Bengaluru
Two Circles
... designs through production operations. - Support the ongoing maintenance and operations of the data platform. Net / C# - Python - AWS or similar - Snowflake ~ SQL - Experience - 8+ years of software engineering experience with a strong data focus, including designing, building, and operating production data systems in fast-paced ...
India, Hyderabad
Funic Tech
... Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate should have hands-on experience with ETL/ELT pipelines, workflow orchestration, AWS cloud services, data ...
India, Pune
Birlasoft
Experience : 7+ years of experience in Data Engineering, Data Quality, or Data Governance. 3+ years of experience working on AWS Data Platforms. Strong hands-on expertise in: - Python - SQL - Data Quality Engineering - Data Profiling - Data Validation Frameworks - Experience building AI-powered data quality and governance ...
India, Hyderabad
Credit Saison India
$2 USD
... production-ready Tableau dashboards. ~ Data Querying (Mandatory): Expert-level command of SQL for data extraction and manipulation. - Proven experience working with data in the Fintech, Banking, or Financial Services sectors. - Soft Skills: Proven ability to engage with non-technical business leaders to understand their data needs ...
India, Mumbai
Urban Company
... influencing metric variations Build Feature Store for Data Science implementations Overall experience of 0-2 yrs. in Advanced Analytics/ Business Intelligence/Data Warehousing Strong Background in Data Transformation Skills – SQL (Mandatory) & Python . Able to understand and align to long term vision of team A phenomenal ...
India, Gurugram
Weekday AI
... dashboards. - Expert-level proficiency in SQL , including complex queries, joins, aggregations, subqueries, and data manipulation. - Strong understanding of data preparation, data modelling, reporting, and visualisation principles. - Experience working with financial, operational, risk, or business performance data. - ...
India, Bengaluru
... Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python / Java / Data Governance Drive ...
India
... data science workloads is desirable. - Demonstrated commitment to technical rigor and model explainability through Responsible AI practices. - Proficiency in Python, SQL, and data engineering for analytical / process data modeling. - Experience in machine learning, deep learning, or optimization algorithms applied to real-world ...
India, Chennai
BDO India
... Requirements Experience: 4 to 6 years of hands-on professional experience Education: BE/B.Tech/ME/M.Tech/MCA/MSc IT Primary Skills (must have): Strong Azure or AWS knowledge Strong working knowledge on Data Science, Artificial Intelligence, Machine Learning Secondary Skills (good to have): SQL, Python Professional Attributes: ...
India, Mumbai