Azure Data Engineer - Python/SQL in Hyderabad, India - Jobeax
Vacancy description
Azure Data Engineer - Python/SQL in Hyderabad, India
India, Hyderabad
Azure Data Engineer - Python/SQL in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
We are looking for an experienced Azure Data Engineer with 8 to 12 years of experience in designing, developing, and maintaining scalable data solutions on Microsoft Azure. The ideal candidate should have strong expertise in Azure Databricks, Azure Data Factory, ADLS, SQL, Python/PySpark, and ETL processes, along with an understanding of ERP data and financial data https://jobeax.com/link/D97KR0fNczjlIZqw Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.- Develop data transformation and processing solutions using Azure Databricks, Python, PySpark, and SQL.- Build and optimize Databricks notebooks for data transformation, cleansing, aggregation, and table creation.- Develop and maintain data ingestion pipelines using Azure Data Factory (ADF).- Work with Azure Data Lake Storage (ADLS) for scalable storage and management of structured and unstructured data.- Integrate data from multiple sources, including ERP systems, databases, APIs, and enterprise applications.- Understand ERP data structures, business processes, and data flows and translate them into scalable data solutions.- Implement data quality, validation, reconciliation, and error-handling processes across data pipelines.- Optimize data pipelines and queries for performance, scalability, reliability, and cost efficiency.- Work with Alteryx and Power BI to support data analysis, reporting, and visualization requirements.- Collaborate with business, analytics, finance, risk, and technology teams to understand requirements and deliver data solutions.- Support data governance, security, audit, and compliance requirements.- Troubleshoot data pipeline and production issues and perform root-cause analysis.- Create technical documentation covering data pipelines, transformations, data flows, and operational procedures.- Contribute to cloud modernization and data platform improvement https://jobeax.com/link/GTNZKF2kxpVUFhTn Skills & Experience :- 8 to 12 years of experience in Data Engineering, ETL, or related data technologies.- Strong hands-on experience with Microsoft Azure data services.- Strong expertise in Azure Databricks and Databricks Notebooks.- Proficiency in SQL and strong programming experience in Python and/or PySpark.- Hands-on experience with Azure Data Factory (ADF).- Strong experience with Azure Data Lake Storage (ADLS).- Strong understanding of ETL/ELT concepts, data integration, data transformation, and data warehousing.- Experience designing and implementing data pipelines using multiple data sources.- Good understanding of Azure cloud services, security, networking, and data platform architecture.- Experience working with ERP data and ERP data flows.- Hands-on experience with Alteryx and Power BI for data analysis and visualization.- Strong understanding of data quality, reconciliation, validation, and performance optimization.- Good analytical, problem-solving, and stakeholder-management skills. (ref:hirist.tech)
... experience with Python, SQL, and PySpark. Strong understanding of unit testing, test automation, debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, ...
... Bachelor/Master's Degree with 4+ years of experience across Data Engineering (Data Pipelining, Warehousing, ETL Tools etc.) Extensive hands-on experience with data engineering techniques and Python & SQL Strong working knowledge of Snowflake, Airflow and dbt You are comfortable and have expertise in data engineering tooling ...
... Skills: Must To Have Skills: Proficiency in Python (Programming Language). Strong understanding of data structures and algorithms. Experience with ETL tools and data integration techniques. Familiarity with cloud platforms such as AWS or Azure. Knowledge of database management systems and SQL. Additional Information: The candidate ...
... Bachelor/Master's Degree with 4+ years of experience across Data Engineering (Data Pipelining, Warehousing, ETL Tools etc.) Extensive hands-on experience with data engineering techniques and Python & SQL Strong working knowledge of Snowflake, Airflow and dbt You are comfortable and have expertise in data engineering tooling ...
... higher in Computer Science, Data Engineering, or a related field (or equivalent professional experience) - 3+ years of experience in data engineering, analytics engineering, or a similar data-focused role - Strong SQL skills, including schema design for data warehouse or data lake use cases - Proficiency in Python for building ...
Job Description: We are looking for a skilled Python SQL and ETL Developer to design build and maintain scalable data pipelines and data integration solutions The ideal candidate will work closely with data engineers analysts and business stakeholders to ensure reliable high quality data delivery for reporting analytics ...
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
... Server and data warehousing concepts. - Must have 2+ years of experience with T-SQL , stored procedures, and performance tuning. - 2+ years of experience with Azure Data Factory , Azure Data Lake , Azure SQL DB , and Azure Synapse Analytics . - Good to have 2+ years of experience with Azure ML , Python , and Scala . - Good ...
... Technology we are looking for a proven Hyperconverged Infrastructure (HCI) Engineer to support and evolve EY's HCI platforms globally. The role will provide engineering, operational support, automation and lifecycle management for Microsoft Azure Stack HCI environments and associated technologies. The successful candidate ...
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate ...
... scale. 1+ years of professional experience in an enterprise software environment - 1+ years of hands-on experience with HTML, CSS, JavaScript, ReactJS, and Python - Experience with databases such as MySQL or Oracle - Strong ability to understand and implement web-based integrations - Bonus Points If You Have Good communication ...
... development - Expertise in building Azure-based data pipelines, including: - Azure Data Factory / Synapse - DataBricks / Synapse Spark Pool - Cosmos DB - Azure Data Lake Storage (ADLS) - Dedicated SQL Pool / Azure SQL - Azure Logic Apps - Hands-on experience with data transformation and cleansing using Spark, Python, R, SQL ...
... vault), and orchestration tools.- Familiarity with Microsoft Purview (or equivalent) for data governance, cataloging, and lineage, plus working knowledge of Azure security, networking, and identity (Entra ID, Private Link, Key Vault, RBAC).- Hands-on scripting/programming in Python, SQL, and/or Spark, and IaC experience. ...
... global projects. - Degree in Engineering, Computer Science, Information Technology, Data Science, or a related discipline. Formal training or certification in Data provisioning will be preferred. Experience: · 5+ years of rich experience with Data provisioning within Supply Chain . (prior experience collaborating with global ...
Role :Lead Engineer - Conversion/Migration Skills - Mandatory-SQL Server, ETL/Data Migration Skills - Good to have -SSIS, Azure Data Factory Work location: Kochi/Trivandrum Total Experience: 6-9 years Strong hands-on expertise in SQL Server (T-SQL) and relational database design, with solid experience in data migration ...
... skills to optimize data delivery and reduce costs Responsible to mentor Data Engineers at all levels of experience Advanced experience with Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, Power BI, SSIS or other cloud-based data systems Advanced experience with Azure DevOps, ...
... with experience support in windows technologies (Azure active directory, Azure,Office365,M365,Intune, Application support, SOP based support), Tools such as Servicenow, Any Monitoring tools like Dynatrace Other business duties as assigned Technology Expertise Azure Active Directory,Azure,Office 365,Intune,Service Desk
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...