Vacancy description
India, Bengaluru
Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : Data Engineer /Lead Data EngineerRole Summary:We are seeking a highly skilled Data Engineer with strong experience in Azure and Databricks, who will play a critical role in designing, transforming, and operationalizing data pipelines within a modern Lakehouse architecture. The role primarily focuses on transforming data from the Bronze layer into curated analytics-ready datasets, building automated CI/CD pipelines, and developing high-quality Python and PySpark-based data solutions. The engineer will also collaborate closely with Data Scientists and Software Engineers and should be open to contributing to data-driven UI/UX https://jobeax.com/link/biLYXB6ZKMbZQuvd and Responsibilities :Data Engineering & Transformation :- Design, develop, and maintain scalable data transformation pipelines using Python (with tools like PySpark, ADF...) and SQL in Azure Databricks.- Implement transformation logic to move data from Bronze to Silver/Gold layers following data engineering best practices.- Apply strong data engineering principles to ensure data reliability, quality, performance, and reusability.- Work with structured and semi-structured data at https://jobeax.com/link/eNmjVrCC3v5NW3BQ, Azure & Cloud ETL :- Build and manage Databricks notebooks, jobs, Delta Lake tables, and orchestrated workflows.- Hands-on experience with Cloud-based ETL platforms.- (Preferred: Microsoft Azure Databricks, Synapse, Azure Functions; otherwise AWS or Google Cloud.- Optimize data pipelines for performance, scalability, and cost https://jobeax.com/link/vHYHCqvmgK49arEE Applications, APIs & Automation :- Design, develop, and maintain Python applications, scripts, and APIs for data processing and automation.- Write production-grade Python code with strong focus on readability, maintainability, and testing.- Leverage Python for orchestration, validation, and integration with downstream https://jobeax.com/link/lnUo88dTl90Z8FLW with Data Science & Engineering Teams :- Collaborate closely with Data Scientists and Data Analysts to understand data, analytical models, and consumption requirements.- Enable and support advanced analytics and data science workflows by preparing high-quality feature datasets.- Translate analytical needs into scalable data engineering https://jobeax.com/link/vi6q0mMALNaTZCZQ DevOps & Platform Engineering :- Build and maintain automated CI/CD pipelines for data and Databricks workloads.- Hands-on experience with DevOps tools and practices, including Git-based version control.- Exposure to containerization and orchestration platforms such as Kubernetes / OpenShift.- Ensure smooth promotion of code and pipelines across environments (Dev/Test/Prod).Data Modeling & Querying :- Design and implement robust data models optimized for analytics and reporting.- Strong hands-on knowledge of SQL and exposure to KQL or other query languages.- Apply best practices in data structures, indexing, and performance tuning UI / UX & Data Applications (Additional Advantage).- Open to contributing to data-driven UI/UX components, dashboards, or lightweight data applications.- Work with analytics and business teams to improve data usability and customer https://jobeax.com/link/TZgXXmjVqOr41M33 Qualifications (Educational Background, Personality, and Skills) :- Strong hands-on expertise in Python (with frameworks like PySpark) .- Solid foundation in Data Engineering principles and large-scale data processing.- Experience with Azure Databricks and cloud-based ETL platforms.- Strong knowledge of SQL and data querying techniques.- Experience with CI/CD pipelines and DevOps practices.- Experience in pipeline monitoring and alerting.- Ability to design efficient, scalable solutions to complex data https://jobeax.com/link/fsPx60LFQp6yJqXp to have :- Experience with Azure Synapse, Azure Functions.- Exposure to AWS or Google Cloud data platforms.- Hands-on experience with OpenShift.- Knowledge of data science concepts and workflows.- Familiarity with analytics platforms, dashboards, and UI/UX considerations. (ref:hirist.tech)
Similar vacancies
... on it with a slick UX. 7+ years of professional software engineering, with Python as your primary language. This is a Python role, not a backend role where Python happens to be in the stack. - FastAPI, or a similar async Python framework such as Starlette, plus SQLAlchemy. Strong SQL and relational database skills. You ...
India, Bengaluru
$60 USD - $130 USD
... other get better. Headout helps people experience the best of every city they visit. What skills & experience do you need - 1 - 3 years in an analytics, BI, or data science role - Strong SQL skills, you can write complex joins, window functions, CTEs without hand-holding. Working knowledge of Python for data manipulation, ...
India, Bengaluru
linkfields innovations (pty) ltd
... Build and optimize data models within Power BI for efficiency and scalability. Develop DAX queries and calculations to enhance dashboard functionality. Ensure data accuracy, consistency, and reliability through proper validation and testing. Work with Data Engineers to integrate multiple data sources (SQL Server, Excel, ...
India, Rāniganj
... problem-solving skills. - Experience with Google Analytics 4, Looker Studio, Power BI, Tableau, Mixpanel, Amplitude, or similar analytics tools. - Good understanding of SQL. - Comfortable working with large datasets. - Ability to convert business questions into data-driven insights. - Strong communication skills. - Attention to detail ...
India, Kochi
Rs 2 - 10.5 lakhs p.a.
... understand data requirements and deliver solutions. Identifying opportunities for process improvements based on data analysis. Assisting in the development of data models and algorithms to enhance business decision-making. Skills and Qualifications Proficiency in data analysis tools such as Python, R, or SQL. Experience ...
India, Rāniganj
... with Python libraries and frameworks like numpy, pandas, pyspark, matplotlib, Flask, FastAPI, TensorFlow, PyTorch, scikit-learn. - Strong skills in software engineering, data processing, analytics and data visualization libraries - Proficiency in data structures, algorithms, building and maintaining data pipelines. - Experience ...
India, Pune
Rs 22 - 60 lakhs p.a.
... Statistics, or a related field. - 8-15 years of experience in data analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. - Strong SQL skills for data querying and manipulation. - Experience with data visualization tools like Tableau or Power BI. - Knowledge of Python or R for data analysis and ...
India, Chennai
Fractal
... understanding of event-driven architecture and real-time data streaming patterns Familiarity with Avro/JSON schema management and Schema Registry Experience integrating data between legacy and modern platforms Strong SQL/Python skills and experience working with relational databases Understanding of data mapping, data quality, and ...
India, Bengaluru
PKO BP
... and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability ...
India, Pune
$11 USD
... solutions over bloated, off-the-shelf enterprise software. Strong programming fundamentals in systems-adjacent or highly performant languages ( Go, Rust, or Python ) alongside advanced mastery of SQL . IoT & Telematics Experience: Proven experience dealing with high-volume, time-series, or streaming telematics/IoT data. ...
India, Bengaluru
Dun & Bradstreet
... Bachelor's degree (preferably in Computer Science, Mathematics, Data Science, or a related field). - 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted ...
India, Rāniganj
BlackBox
... Computer Science, IT, Data Science, Mathematics, or a related field (Recent graduates from batch [Year] are welcome). Python: Solid foundational knowledge of Python programming (data structures, loops, functions, basic libraries like Pandas). PostgreSQL (SQL): Basic understanding of relational databases, table design, and ...
India, Mumbai
PayPay India
... ability to design, build, and operate Data Lakes or Data Warehouses. Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect). Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell). Strong command of at least one primary language (Scala, Python, etc.) and SQL. Experience with data catalog and metadata ...
India, Gurugram
Andor Tech
... https://jobeax.com/link/8om4ubga9gvjbUNE Contact: View phone number on https://jobeax.com/link/8om4ubga9gvjbUNE #Hiring #DataEngineer #SeniorDataEngineer #AzureDatabricks #Databricks #PySpark #PythonDeveloper #AzureCloud #DataEngineering #BigData #ADF #ADLS #SQL #BangaloreJobs #TechHiring #AndorTech #HiringNow #DataPlatform #CloudEngineering #CareerOpportunity
India, Bengaluru
infovision inc.
... and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management ...
India, Pune
monk's hill ventures
... real-time decisioning. Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems. Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Comfortable with SQL and a transformation framework (e.g., Familiarity with ...
India, Bengaluru
Appsierra Group
... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...
India, Pune
Azilen Technologies
... Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing ...
India, Ahmedabad
Auriga IT
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
India, Jaipur
altysys
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
India, Gurugram