Vacancy description
India, Bengaluru
Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : Data Engineer /Lead Data EngineerRole Summary:We are seeking a highly skilled Data Engineer with strong experience in Azure and Databricks, who will play a critical role in designing, transforming, and operationalizing data pipelines within a modern Lakehouse architecture. The role primarily focuses on transforming data from the Bronze layer into curated analytics-ready datasets, building automated CI/CD pipelines, and developing high-quality Python and PySpark-based data solutions. The engineer will also collaborate closely with Data Scientists and Software Engineers and should be open to contributing to data-driven UI/UX https://jobeax.com/link/biLYXB6ZKMbZQuvd and Responsibilities :Data Engineering & Transformation :- Design, develop, and maintain scalable data transformation pipelines using Python (with tools like PySpark, ADF...) and SQL in Azure Databricks.- Implement transformation logic to move data from Bronze to Silver/Gold layers following data engineering best practices.- Apply strong data engineering principles to ensure data reliability, quality, performance, and reusability.- Work with structured and semi-structured data at https://jobeax.com/link/eNmjVrCC3v5NW3BQ, Azure & Cloud ETL :- Build and manage Databricks notebooks, jobs, Delta Lake tables, and orchestrated workflows.- Hands-on experience with Cloud-based ETL platforms.- (Preferred: Microsoft Azure Databricks, Synapse, Azure Functions; otherwise AWS or Google Cloud.- Optimize data pipelines for performance, scalability, and cost https://jobeax.com/link/vHYHCqvmgK49arEE Applications, APIs & Automation :- Design, develop, and maintain Python applications, scripts, and APIs for data processing and automation.- Write production-grade Python code with strong focus on readability, maintainability, and testing.- Leverage Python for orchestration, validation, and integration with downstream https://jobeax.com/link/lnUo88dTl90Z8FLW with Data Science & Engineering Teams :- Collaborate closely with Data Scientists and Data Analysts to understand data, analytical models, and consumption requirements.- Enable and support advanced analytics and data science workflows by preparing high-quality feature datasets.- Translate analytical needs into scalable data engineering https://jobeax.com/link/vi6q0mMALNaTZCZQ DevOps & Platform Engineering :- Build and maintain automated CI/CD pipelines for data and Databricks workloads.- Hands-on experience with DevOps tools and practices, including Git-based version control.- Exposure to containerization and orchestration platforms such as Kubernetes / OpenShift.- Ensure smooth promotion of code and pipelines across environments (Dev/Test/Prod).Data Modeling & Querying :- Design and implement robust data models optimized for analytics and reporting.- Strong hands-on knowledge of SQL and exposure to KQL or other query languages.- Apply best practices in data structures, indexing, and performance tuning UI / UX & Data Applications (Additional Advantage).- Open to contributing to data-driven UI/UX components, dashboards, or lightweight data applications.- Work with analytics and business teams to improve data usability and customer https://jobeax.com/link/TZgXXmjVqOr41M33 Qualifications (Educational Background, Personality, and Skills) :- Strong hands-on expertise in Python (with frameworks like PySpark) .- Solid foundation in Data Engineering principles and large-scale data processing.- Experience with Azure Databricks and cloud-based ETL platforms.- Strong knowledge of SQL and data querying techniques.- Experience with CI/CD pipelines and DevOps practices.- Experience in pipeline monitoring and alerting.- Ability to design efficient, scalable solutions to complex data https://jobeax.com/link/fsPx60LFQp6yJqXp to have :- Experience with Azure Synapse, Azure Functions.- Exposure to AWS or Google Cloud data platforms.- Hands-on experience with OpenShift.- Knowledge of data science concepts and workflows.- Familiarity with analytics platforms, dashboards, and UI/UX considerations. (ref:hirist.tech)
Similar vacancies
Spectrum Consulting
Experience : 6 - 10 YearsRequired Technical Skills : - Databricks (Data Engineering, SQL Warehouses, Delta Tables, Data Validation)- Python (Pandas, Automation, Data Processing, Reporting Solutions)- SQL (Advanced querying, optimization, joins, window functions, RCA)- Tableau (Dashboard development, performance tuning, ...
India, Chennai
Spectrum Consulting
Experience : 6 - 10 YearsRequired Technical Skills : - Databricks (Data Engineering, SQL Warehouses, Delta Tables, Data Validation)- Python (Pandas, Automation, Data Processing, Reporting Solutions)- SQL (Advanced querying, optimization, joins, window functions, RCA)- Tableau (Dashboard development, performance tuning, ...
India, Gurugram
Artech Infosystems Private Limited
Rs 8 - 18 lakhs p.a.
... Responsibilities Design, develop, test, and maintain applications using Python . Develop reusable, scalable, and maintainable Python code. Write complex and optimized SQL queries , stored procedures, joins, subqueries, and CTEs. Work with relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server . Develop and integrate ...
India, Chennai
Artech Infosystems Private Limited
Rs 8 - 18 lakhs p.a.
... Responsibilities Design, develop, test, and maintain applications using Python . Develop reusable, scalable, and maintainable Python code. Write complex and optimized SQL queries , stored procedures, joins, subqueries, and CTEs. Work with relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server . Develop and integrate ...
India, Bengaluru
Porch Group
... subject matter expert in SQL and database performance. What You Will Do As A Data Warehouse Engineer Build and monitor robust ETL/ELT pipelines using BigQuery, Dataflow, and Cloud Composer. Expert SQL Execution: Develop high-performance SQL scripts for complex data transformations, ensuring accuracy across multiple datasets. ...
India, India
ALTEN Calsoft Labs
... design and implement automated data pipelines and materialized views. - Proficiency in Python, Unix or similar languages. - Good understanding of SQL oracle, SQL server or similar languages. - Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions). - Core Engineering: Data structures/algorithms, ...
India, Bengaluru
Rackspace Technology
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
India, Bengaluru
sapphire software solutions inc
... Shishir's team, Data analytics CoE head. Someone that can help with the reporting needs, need resource who can support here. Require more data visualization, know data engineering as well. -SQL Tableau -SQL - Need to create data for powerBI and tableua, done in SQL - BCG Data Lake is entirely snowflake - Write SQL queries in ...
India, India
APEXX Global
... integrate data solutions into the overall architecture. Previous experience in Data Engineering, we're looking for around 3-7 years worth of experience. Strong SQL skills and experience working with relational databases such as Snowflake, PostgreSQL, or MySQL. Experience building and maintaining data pipelines and ETL workflows ...
India, Pune
InterEx Group
... modelers and analysts to deliver analytics-ready datasets Support downstream reporting and dashboarding use cases What we’re looking for Strong experience as a Data Engineer in Azure environments Hands-on with tools such as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience ...
India, Mumbai
Delta System & Software, Inc.
... data code (DDL, DML, dbt/SQL projects, Python packages). Strong automation mindset with experience eliminating manual data-ops activities through scripting (Python, PowerShell, or Bash) and orchestration tools (Airflow, dbt, Snowflake Tasks, or equivalent). Experience working within Agile engineering teams using modern ...
India, Mumbai
Addepar
1400 / year
... product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage with Engineering & Product when needed. Partner with Account Managers, ...
India, Pune
... demonstrate technical and non-technical information, ideas, procedures, and processes Prior experience in an SAP and/or Informatica driven environment Ability to use SQL to analyze data Bachelor's degree related to Information Systems, Business or other relevant academic discipline with a minimum 4 years job experience in IT or ...
India, Bengaluru
MaimsD Technology
... https://jobeax.com/link/2luqtWY4b55DMQvB Skills and Qualifications :- Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.- Advanced proficiency in Python for data processing, automation, and integration.- Deep understanding of relational and NoSQL databases, including ...
India
KPI PARTNERS INDIA PRIVATE LIMITED
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...
India, Hyderabad
KPI PARTNERS INDIA PRIVATE LIMITED
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...
India, Bengaluru
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
India, Gurugram
Data Eminence
... understanding of SQL and relational databases - Basic understanding of statistics and data analysis techniques - Familiarity with Power BI, Tableau, or similar data visualization tools - Basic knowledge of data cleaning and data preparation - Familiarity with Python and libraries such as Pandas or NumPy is a plus - Understanding ...
India, India
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
India, Pune
Axtria - Ingenious Insights
... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...
India, Gurugram