Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview : We are looking for a Data Engineer with strong hands-on experience in Python, SQL, and Spark to build and maintain scalable data pipelines and integration solutions. The ideal candidate should have experience with Azure data technologies and ETL/ELT https://jobeax.com/link/OfTNakiwtq51n9YB Responsibilities : - Develop and maintain scalable data pipelines using Python, SQL, and Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, and pipelines for performance and scalability.- Perform data validation, quality checks, and troubleshooting of pipeline failures.- Monitor data pipelines and resolve issues across development and production environments.- Collaborate with data scientists, analysts, and technology teams to deliver data https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack & Requirements : - Strong proficiency in Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- Strong troubleshooting and analytical skills.- Good understanding of cloud-based data platforms. (ref:hirist.tech)
... Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration Python PySpark Strong SQL and data engineering fundamentals hands-on experience in GCP-based data platforms.
... Qualifications - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - 2 to 3 years of hands-on professional experience in data engineering or ETL development. - Strong proficiency in writing and tuning SQL queries across relational databases (e.g., PostgreSQL, MySQL, SQL Server). - Hands-on ...
... Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.- 5 - 8 years of hands-on experience with strong programming skills in Python for data manipulation and processing.- Proficiency in SQL for querying and data transformation.- Hands-on experience or significant project work with Google ...
... end-to-end ML workflows from data ingestion to model https://jobeax.com/link/6K228mqDEvef9KNC Qualifications & Skills :- 2 to 4 years of experience in AI/ML engineering or data science roles.- Proficiency in Python, especially for ML development.- Hands-on experience with TensorFlow, PyTorch, or similar ML frameworks.- Exposure ...
... maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline design patterns - PySpark: Proven hands-on experience developing data pipelines using PySpark, including DataFrames API, Spark SQL, and performance optimization ...
... solutions. Ensure data quality, performance, reliability, and scalability. Required Skills: - 7+ years of Data Engineering experience. - Strong experience in Data Modeling, Data Warehousing, and ETL development. - Proficiency in Python, Java, Scala, or NodeJS. - 3+ years of SQL experience. - Experience building and operating ...
... MAKE AN IMPACT Job Title: Data Engineer _DEPS Experience: 3–5 Years Location: Bangalore and Pune (Hybrid – Client Office) Job Summary: Seeking a skilled Senior Data DevOps Engineer having experience in Cloudera platforms, data engineering, and DevOps automation. The ideal candidate will manage and optimize Cloudera environments, ...
Role Overview : We are seeking a seasoned AI Engineer to join our innovation hub in Gurgaon. - In this role, you will architect and deploy sophisticated machine learning models that transform complex datasets into actionable business intelligence. - You will collaborate closely with cross-functional product teams, data ...
... Provide clarity on risks, constraints, priorities, and delivery strategies. Ability to move from need problem capability solution implementation . Software Engineering & Architecture Strong software engineering experience in Python, TypeScript, Java, or equivalent technologies. Experience designing and developing distributed ...
... experience evaluating and implementing data-engineering and software technologies - In addition, you have experience in programming languages and frameworks: SQL, Python, Spark, Databricks (Delta Lake) - Experience in data storages - SQL and NoSQL databases, Azure Data Lake Storage- and in developing data solutions, models, ...
Job Summary:We are seeking a highly skilled and experienced Senior Azure Engineer (DevOps & Database) to lead the design, build, and management of our Microsoft Azure cloud infrastructure, with a specific focus on Windows-based application hosting, SQL Server database engineering, and DevOps delivery https://jobeax.com/link/7yDwjVoYn8HZ8pTw ...
... frameworks natively in Databricks (audit logging, reconciliation, DQ checks) Experience with Delta Lake features: MERGE, CDC, time travel, schema enforcement Data Engineering & Development Strong Python and SQL programming skills Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data ...
... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...
... data engineering solutions aligned to enterprise standards Build and optimize batch and streaming data pipelines using AWS native and opensource tools Develop SQLdriven transformations and Pythonbased data pipelines for analytics use cases Design efficient data models for performance, scalability, and cost effectiveness ...
... rest of the company's data stack runs on. - Write and maintain internal Python libraries (including shared Airflow operators and frameworks) consumed by other engineering teams. - Build and operate Temporal-based workflow systems for long-running, reliable distributed data workflows. - Build internal data platform applications, ...
... & Data Platform. You’ll design and maintain reliable, secure, and scalable data pipelines and models that power a new generation of reporting, insights, and data-driven products across the StarRez ecosystem. This role sits at the intersection of data, product, and engineering. You will work closely with Data Analysts, ...
... performance. Implement indexing, partitioning, and query optimization techniques. Manage PostgreSQL, NoSQL databases, and caching solutions (e.g., Redis). Execute database migrations using tools like Alembic . Backend Development & System Architecture Develop scalable REST APIs using Flask/FastAPI and Python. Design and maintain ...
... for an experienced Data Engineer to design, develop, and maintain scalable data platforms and pipelines using AWS, Apache Spark, Python, SQL, Kafka, and modern data engineering frameworks . The role will focus on building reliable data solutions for high-volume batch and real-time workloads, including data ingestion, transformation, ...
Sr Software Engineer III - AI (IND) IFT Engineering /Dev Shift Senior Software Engineer III - AI Full-Time Employee LLM, ML, NLP, Python, AWS, Snowflake, SQL Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health ...
... and results-driven Data Engineer to join our growing Data Engineering team. You will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making for our clients. This role is ideal for someone who thrives in a consulting environment, enjoys solving complex data challenges, ...