Vacancy description
India, Bengaluru
Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : Data Engineer /Lead Data EngineerRole Summary:We are seeking a highly skilled Data Engineer with strong experience in Azure and Databricks, who will play a critical role in designing, transforming, and operationalizing data pipelines within a modern Lakehouse architecture. The role primarily focuses on transforming data from the Bronze layer into curated analytics-ready datasets, building automated CI/CD pipelines, and developing high-quality Python and PySpark-based data solutions. The engineer will also collaborate closely with Data Scientists and Software Engineers and should be open to contributing to data-driven UI/UX https://jobeax.com/link/biLYXB6ZKMbZQuvd and Responsibilities :Data Engineering & Transformation :- Design, develop, and maintain scalable data transformation pipelines using Python (with tools like PySpark, ADF...) and SQL in Azure Databricks.- Implement transformation logic to move data from Bronze to Silver/Gold layers following data engineering best practices.- Apply strong data engineering principles to ensure data reliability, quality, performance, and reusability.- Work with structured and semi-structured data at https://jobeax.com/link/eNmjVrCC3v5NW3BQ, Azure & Cloud ETL :- Build and manage Databricks notebooks, jobs, Delta Lake tables, and orchestrated workflows.- Hands-on experience with Cloud-based ETL platforms.- (Preferred: Microsoft Azure Databricks, Synapse, Azure Functions; otherwise AWS or Google Cloud.- Optimize data pipelines for performance, scalability, and cost https://jobeax.com/link/vHYHCqvmgK49arEE Applications, APIs & Automation :- Design, develop, and maintain Python applications, scripts, and APIs for data processing and automation.- Write production-grade Python code with strong focus on readability, maintainability, and testing.- Leverage Python for orchestration, validation, and integration with downstream https://jobeax.com/link/lnUo88dTl90Z8FLW with Data Science & Engineering Teams :- Collaborate closely with Data Scientists and Data Analysts to understand data, analytical models, and consumption requirements.- Enable and support advanced analytics and data science workflows by preparing high-quality feature datasets.- Translate analytical needs into scalable data engineering https://jobeax.com/link/vi6q0mMALNaTZCZQ DevOps & Platform Engineering :- Build and maintain automated CI/CD pipelines for data and Databricks workloads.- Hands-on experience with DevOps tools and practices, including Git-based version control.- Exposure to containerization and orchestration platforms such as Kubernetes / OpenShift.- Ensure smooth promotion of code and pipelines across environments (Dev/Test/Prod).Data Modeling & Querying :- Design and implement robust data models optimized for analytics and reporting.- Strong hands-on knowledge of SQL and exposure to KQL or other query languages.- Apply best practices in data structures, indexing, and performance tuning UI / UX & Data Applications (Additional Advantage).- Open to contributing to data-driven UI/UX components, dashboards, or lightweight data applications.- Work with analytics and business teams to improve data usability and customer https://jobeax.com/link/TZgXXmjVqOr41M33 Qualifications (Educational Background, Personality, and Skills) :- Strong hands-on expertise in Python (with frameworks like PySpark) .- Solid foundation in Data Engineering principles and large-scale data processing.- Experience with Azure Databricks and cloud-based ETL platforms.- Strong knowledge of SQL and data querying techniques.- Experience with CI/CD pipelines and DevOps practices.- Experience in pipeline monitoring and alerting.- Ability to design efficient, scalable solutions to complex data https://jobeax.com/link/fsPx60LFQp6yJqXp to have :- Experience with Azure Synapse, Azure Functions.- Exposure to AWS or Google Cloud data platforms.- Hands-on experience with OpenShift.- Knowledge of data science concepts and workflows.- Familiarity with analytics platforms, dashboards, and UI/UX considerations. (ref:hirist.tech)
Similar vacancies
SHIMENTO INDIA LLP
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
India, Bengaluru
Birlasoft
Experience : 7+ years of experience in Data Engineering, Data Quality, or Data Governance. 3+ years of experience working on AWS Data Platforms. Strong hands-on expertise in: - Python - SQL - Data Quality Engineering - Data Profiling - Data Validation Frameworks - Experience building AI-powered data quality and governance ...
India, Hyderabad
Credit Saison India
$2 USD
... production-ready Tableau dashboards. ~ Data Querying (Mandatory): Expert-level command of SQL for data extraction and manipulation. - Proven experience working with data in the Fintech, Banking, or Financial Services sectors. - Soft Skills: Proven ability to engage with non-technical business leaders to understand their data needs ...
India, Mumbai
Urban Company
... influencing metric variations Build Feature Store for Data Science implementations Overall experience of 0-2 yrs. in Advanced Analytics/ Business Intelligence/Data Warehousing Strong Background in Data Transformation Skills – SQL (Mandatory) & Python . Able to understand and align to long term vision of team A phenomenal ...
India, Gurugram
Weekday AI
... dashboards. - Expert-level proficiency in SQL , including complex queries, joins, aggregations, subqueries, and data manipulation. - Strong understanding of data preparation, data modelling, reporting, and visualisation principles. - Experience working with financial, operational, risk, or business performance data. - ...
India, Bengaluru
... Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python / Java / Data Governance Drive ...
India
... data science workloads is desirable. - Demonstrated commitment to technical rigor and model explainability through Responsible AI practices. - Proficiency in Python, SQL, and data engineering for analytical / process data modeling. - Experience in machine learning, deep learning, or optimization algorithms applied to real-world ...
India, Chennai
BDO India
... hands-on professional experience Education: BE/B.Tech/ME/M.Tech/MCA/MSc IT Primary Skills (must have): Strong Azure or AWS knowledge Strong working knowledge on Data Science, Artificial Intelligence, Machine Learning Secondary Skills (good to have): SQL, Python Professional Attributes: Strong analytical and problem-solving ...
India, Mumbai
... leadership teams. Provide technical guidance and mentoring to junior data scientists and analysts. Collaborate with global teams and external partners to deliver data-driven solutions. Advanced knowledge of Python, SQL, and modern data science libraries. Strong experience with machine learning, deep learning, and statistical ...
India, Bengaluru
AngelONE
... curation, feature engineering, model training, model tuning, and offline & online experimentation Strong programming skills with minimum 3-6 years of experience in Python Experience working with databases and expert knowledge of SQL Proficiency in statistical ML algorithms and statistics analysis methods Good knowledge of machine ...
India, Bengaluru
FundsIndia
... Storytelling- translate technical findings into clear, actionable recommendations for non-technical stakeholders, including senior leadership. 3-4 years of experience in data science, analytics, or a related quantitative role, ideally handling large, real-world datasets. - Strong hands-on skills in Python and SQL, with solid fundamentals ...
India, Bengaluru
... of experience in data analytics or a related field Strong hands-on experience with: SQL Python Power BI and/or Tableau Solid understanding of data modeling, data cleaning, and transformation techniques Experience working with structured and unstructured datasets Familiarity with statistical analysis and data visualization ...
India, Bengaluru
anko gcc
... will be a plus Track record in managing deliveries of advanced analytical solutions in an agile & iterative model. - Expertise in tools required to execute a data science project - SQL, Python, R, ML algorithms - Expertise in using Cloud solutions(AWS, Azure, etc.) for deploying data science projects - Synthesizing findings ...
India, Bengaluru
EMERGEnT
$100 USD
... familiarity with topic-modeling and trace-clustering approaches (Clio-style summarize-then-embed pipelines, BERTopic, c-TF-IDF) is a strong plus - Proficient in Python and the standard data-science stack (pandas, scikit-learn, statsmodels, numpy) - Data engineering competence — you can design and ship ETL and data models (dbt ...
India, Bengaluru
DigitalCube Consultancy
DATA SCIENTIST - TIME SERIES FORECASTINGAre you a Data Scientist who loves turning historical data into accurate predictions and actionable business insights?Were looking for a Data Scientist with strong hands-on experience in Time-Series Forecasting, Machine Learning, Python/R and SQL to build forecasting solutions that ...
India, Hyderabad
... pipelines for our analytics needs. Conduct in-depth product analysis to identify trends, patterns, and opportunities for product improvement and growth. Write complex SQL queries and use Python to perform advanced data analysis Collaborate with product managers, engineers, and other stakeholders to understand their data needs and ...
India, Bengaluru
Bahwan Cybertek
... translate stakeholder needs into clear, testable requirements and communicate effectively with technical teams. Strong SQL skills and experience working with large datasets. Familiarity with modern data environments and tooling (e.g., Databricks, ETL/ELT concepts, Azure, ADF, Python). Experience with governed data environments ...
India, Chennai
CommerceIQ
... Proficiency in Python, Pandas, NumPy, Scikit-learn, with experience using libraries such as XGBoost, LightGBM, CatBoost, and Statsmodels. Experience working with large datasets and data pipelines, including data preprocessing, data quality checks, transformation, aggregation, and feature generation using tools such as SQL, Spark/PySpark, ...
India, Bengaluru
Squareroot Consulting Pvt Ltd
... https://jobeax.com/link/SxaWoIptPtnP4xy1 Skills:- 6 to 10 years of experience in Data Analysis / Data Analytics.- Strong proficiency in SQL, Excel (Pivot Tables, Advanced Functions), and Python.- Experience in data modeling, reporting, and dashboarding.- Strong analytical and problem-solving skills.- Ability to work with large and complex datasets.- ...
India, Pune
CodeChavo
... rather than developing new algorithms.- Translate business goals into AI-powered solutions, ensuring technical feasibility through collaboration with squad leads, data scientists, architects, and full stack engineers.- Integrate Google Cloud AI services and models into microservices and workflows to support scalable and maintainable ...
India, Pune