Data Engineer - Python, AWS, SQL in Bengaluru, India
India, Bengaluru
Data Engineer - Python, AWS, SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Position Overview:We are looking for a Data Engineer with hands-on experience in Apache Airflow, Python, and Jupyter Notebook to build, orchestrate, and maintain robust data pipelines that power our analytics and business decisions. In this role, you will work closely with data teams to clean, transform, and move data reliably across our platforms while ensuring pipeline performance and data integrity at https://jobeax.com/link/AwOVwl2FkAY2iw53 Architecture:- Design, build, and maintain scalable ETL/ELT data pipelines using Apache Airflow and https://jobeax.com/link/9BZSgic8TwoqWitR & Workflow:- Schedule, monitor, optimize, and troubleshoot Airflow DAGs to ensure reliable, high-availability data https://jobeax.com/link/zruxWYQz3eqyaZpe Processing:- Perform data extraction, cleaning, transformation, and validation across structured and unstructured multi-source https://jobeax.com/link/sluZEnCJKJyUJkcP & Analysis:- Use Jupyter Notebook for exploratory data analysis, pipeline testing, data profiling, and rapid prototyping.Cross-Team Collaboration:- Partner with data analysts, data scientists, and product teams to translate business requirements into reliable data https://jobeax.com/link/slfm2H5M70Q62wJ5 & Performance:- Ensure high data quality, strict data integrity, and pipeline execution speed at scale.Documentation:- Maintain clean, clear documentation for all data pipelines, lineage, and operational https://jobeax.com/link/iF5NRBBcXKPJeYbp Qualifications:Experience:- 1 to 2 years of hands-on, production experience in data https://jobeax.com/link/lptHFLDlMUnekis0 Proficiency:- Strong proficiency in Python for data manipulation, ETL scripting, and https://jobeax.com/link/DH9RkYsfBywYaX8K Orchestration:- Working experience with Apache Airflow (DAG creation, task dependencies, custom operators, and scheduling).Prototyping Tools:- High comfort level working in Jupyter Notebook for data prototyping and interactive https://jobeax.com/link/zlk2beUnqej1rgqa Foundations:- Solid understanding of SQL, relational/non-relational databases, and data modeling https://jobeax.com/link/SKciAM5XjIOOw9Ja Qualifications:Education:- https://jobeax.com/link/2DENLGgQM7whDhaE / B.E. in Computer Science, Data Science, or a related field, preferably from a premier institution (NIT or IIT).Cloud Infrastructure:- Familiarity with major cloud environments (AWS, GCP, or Azure).Big Data Technologies:- Exposure to distributed computing frameworks like Apache Spark, streaming platforms like Kafka, or cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).Shift Timing:- 10:00 AM 7:00 PM IST (ref:hirist.
... leadership teams. Provide technical guidance and mentoring to junior data scientists and analysts. Collaborate with global teams and external partners to deliver data-driven solutions. Advanced knowledge of Python, SQL, and modern data science libraries. Strong experience with machine learning, deep learning, and statistical ...
... curation, feature engineering, model training, model tuning, and offline & online experimentation Strong programming skills with minimum 3-6 years of experience in Python Experience working with databases and expert knowledge of SQL Proficiency in statistical ML algorithms and statistics analysis methods Good knowledge of machine ...
... Storytelling- translate technical findings into clear, actionable recommendations for non-technical stakeholders, including senior leadership. 3-4 years of experience in data science, analytics, or a related quantitative role, ideally handling large, real-world datasets. - Strong hands-on skills in Python and SQL, with solid fundamentals ...
... of experience in data analytics or a related field Strong hands-on experience with: SQL Python Power BI and/or Tableau Solid understanding of data modeling, data cleaning, and transformation techniques Experience working with structured and unstructured datasets Familiarity with statistical analysis and data visualization ...
... will be a plus Track record in managing deliveries of advanced analytical solutions in an agile & iterative model. - Expertise in tools required to execute a data science project - SQL, Python, R, ML algorithms - Expertise in using Cloud solutions(AWS, Azure, etc.) for deploying data science projects - Synthesizing findings ...
... familiarity with topic-modeling and trace-clustering approaches (Clio-style summarize-then-embed pipelines, BERTopic, c-TF-IDF) is a strong plus - Proficient in Python and the standard data-science stack (pandas, scikit-learn, statsmodels, numpy) - Data engineering competence — you can design and ship ETL and data models (dbt ...
DATA SCIENTIST - TIME SERIES FORECASTINGAre you a Data Scientist who loves turning historical data into accurate predictions and actionable business insights?Were looking for a Data Scientist with strong hands-on experience in Time-Series Forecasting, Machine Learning, Python/R and SQL to build forecasting solutions that ...
... pipelines for our analytics needs. Conduct in-depth product analysis to identify trends, patterns, and opportunities for product improvement and growth. Write complex SQL queries and use Python to perform advanced data analysis Collaborate with product managers, engineers, and other stakeholders to understand their data needs and ...
... translate stakeholder needs into clear, testable requirements and communicate effectively with technical teams. Strong SQL skills and experience working with large datasets. Familiarity with modern data environments and tooling (e.g., Databricks, ETL/ELT concepts, Azure, ADF, Python). Experience with governed data environments ...
... Proficiency in Python, Pandas, NumPy, Scikit-learn, with experience using libraries such as XGBoost, LightGBM, CatBoost, and Statsmodels. Experience working with large datasets and data pipelines, including data preprocessing, data quality checks, transformation, aggregation, and feature generation using tools such as SQL, Spark/PySpark, ...
... https://jobeax.com/link/SxaWoIptPtnP4xy1 Skills:- 6 to 10 years of experience in Data Analysis / Data Analytics.- Strong proficiency in SQL, Excel (Pivot Tables, Advanced Functions), and Python.- Experience in data modeling, reporting, and dashboarding.- Strong analytical and problem-solving skills.- Ability to work with large and complex datasets.- ...
... rather than developing new algorithms.- Translate business goals into AI-powered solutions, ensuring technical feasibility through collaboration with squad leads, data scientists, architects, and full stack engineers.- Integrate Google Cloud AI services and models into microservices and workflows to support scalable and maintainable ...
... on it with a slick UX. 7+ years of professional software engineering, with Python as your primary language. This is a Python role, not a backend role where Python happens to be in the stack. - FastAPI, or a similar async Python framework such as Starlette, plus SQLAlchemy. Strong SQL and relational database skills. You ...
... other get better. Headout helps people experience the best of every city they visit. What skills & experience do you need - 1 - 3 years in an analytics, BI, or data science role - Strong SQL skills, you can write complex joins, window functions, CTEs without hand-holding. Working knowledge of Python for data manipulation, ...
... business, IT, and data engineering. Preferred Qualifications: Experience with other visualization tools (Tableau, Qlik) in addition to Power BI. Knowledge of Python for advanced data analysis and automation. Familiarity with Azure Synapse, AWS Redshift, or Google BigQuery. Experience with data governance, quality, and compliance ...
... problem-solving skills. - Experience with Google Analytics 4, Looker Studio, Power BI, Tableau, Mixpanel, Amplitude, or similar analytics tools. - Good understanding of SQL. - Comfortable working with large datasets. - Ability to convert business questions into data-driven insights. - Strong communication skills. - Attention to detail ...
... understand data requirements and deliver solutions. Identifying opportunities for process improvements based on data analysis. Assisting in the development of data models and algorithms to enhance business decision-making. Skills and Qualifications Proficiency in data analysis tools such as Python, R, or SQL. Experience ...
... with Python libraries and frameworks like numpy, pandas, pyspark, matplotlib, Flask, FastAPI, TensorFlow, PyTorch, scikit-learn. - Strong skills in software engineering, data processing, analytics and data visualization libraries - Proficiency in data structures, algorithms, building and maintaining data pipelines. - Experience ...
... analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. - Strong SQL skills for data querying and manipulation. - Experience with data visualization tools like Tableau or Power BI. - Knowledge of Python or R for data analysis and scripting. - Familiarity with cloud platforms such as AWS or Azure. ...
... computer science, Engineering, or a related field.- 8-10 years of experience in data engineering, with at least 3 years in a leadership role.- Proficient in Python programming and experience with Airflow for workflow management.- Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics ...