Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview : We are looking for a Data Engineer with strong hands-on experience in Python, SQL, and Spark to build and maintain scalable data pipelines and integration solutions. The ideal candidate should have experience with Azure data technologies and ETL/ELT https://jobeax.com/link/OfTNakiwtq51n9YB Responsibilities : - Develop and maintain scalable data pipelines using Python, SQL, and Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, and pipelines for performance and scalability.- Perform data validation, quality checks, and troubleshooting of pipeline failures.- Monitor data pipelines and resolve issues across development and production environments.- Collaborate with data scientists, analysts, and technology teams to deliver data https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack & Requirements : - Strong proficiency in Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- Strong troubleshooting and analytical skills.- Good understanding of cloud-based data platforms. (ref:hirist.tech)
... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...
... Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure ...
... Strong experience with SQL and working with APIs is required. Familiarity with data warehousing concepts and tools such as Azure Data Factory or equivalent. Data Handling: Expertise in data engineering, including data cleaning, transformation, and preparation for analysis. Knowledge of data modelling, database design, ...
... DAX expressions. Perform storyboarding to structure analytical insights and present clear, compelling narratives to stakeholders. Collaborate closely with Data Engineering teams by providing clear and detailed requirements. Ensure data accuracy, consistency, and adherence to best practices in reporting and analytics ...
Role Overview : We are seeking a seasoned Data/SQL Business Analyst to join our high-growth team in Delhi NCR/Gurgaon. In this role, you will serve as the bridge between complex raw data and actionable business strategy, translating technical insights into intuitive dashboards that drive decision-making for senior leadership. ...
... DAX expressions. Perform storyboarding to structure analytical insights and present clear, compelling narratives to stakeholders. Collaborate closely with Data Engineering teams by providing clear and detailed requirements. Ensure data accuracy, consistency, and adherence to best practices in reporting and analytics ...
... applications for accuracy, latency, and cost. Implement data preprocessing, feature engineering, and ML model training workflows. Work with structured and unstructured datasets to solve business problems. Collaborate with Product Managers, Software Engineers, and Subject Matter Experts to deliver AI-driven features. Monitor model ...
... scalable solutions Generate actionable insights through data analysis and modeling Deploy, monitor, and improve model performance Qualifications - Bachelor's/Master's in Computer Science, Data Science, Engineering, or related field - 3–8 years of relevant experience Skills: data scientist,genai,python,sql,pyspark,aiml,ml
... in data science. Required qualifications : - Bachelor's or Master's degree in Data Science, Computer Science, or a related field. - 3-5 years of experience in data science or a related discipline. - Proficiency in generative AI and large language models. - Strong programming skills in languages such as Python or R. - Experience ...
... lifecycle from problem formulation, data acquisition, data cleaning to model building and deployment at enterprise https://jobeax.com/link/AsTDTp6i8kJTEE83 in Python or R, ML frameworks (PyTorch, TensorFlow, scikit-learn) and libraries (NumPy, pandas). Experience with software engineering practices, agile methodologies and ...
... with real users behind them.- Production Azure experience : identity, secrets, app hosting, pipelines.- Strong SQL (SQL Server and/or Postgres) and multi-tenant data-access design.- Auth fundamentals : OAuth2/OIDC, JWT.- Self-directed - you'll often be the only engineer on the problem.- Bonus : US healthcare data (claims, ...
... ingestion pipelines (Azure Data Factory or Fabric Pipelines) from various sources.- Data Transformation & Modeling: Implement data transformations using Fabric Dataflows Gen2, Spark SQL, and Python.- OneLake & Data Warehouse Management: Manage storage in OneLake, build SQL analytics endpoints, and optimize data warehousing.- ...
About the Role:We are looking for an experienced AWS Data Engineer with 6 - 8 years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions on AWS. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS data services, with experience building robust ...
... in Python and SQL - Experience with Unity Catalog, cluster administration, and at least one major cloud platform (Azure, AWS, or GCP) - Solid understanding of data warehousing and dimensional modeling Databricks Certified Data Engineer (Associate or Professional) Cloud data engineering certification have minimum 5 years ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...