Back to list

Vacancy description

RandomTrees - Senior Data Engineer - PySpark/Azure Databricks in Hyderabad, भारत

RANDOMTREES PRIVATE LIMITED

Hyderabad, भारत

About the Job : We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).You will be responsible for developing efficient data solutions, optimizing workflows, and ensuring data reliability to support business https://jobeax.com/link/nEC7Pw3JSppzjDvo Responsibilities : - Design, develop, and deploy high-performance data pipelines using PySpark, Databricks, and Azure Data Factory (ADF).- Optimize and maintain SQL queries, stored procedures, and ETL processes for large-scale data processing.- Work with Azure cloud services (Azure Data Lake, Azure Synapse, Blob Storage, etc.) to build scalable data solutions.- Implement data integration, transformation, and warehousing solutions in Databricks.- Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver actionable insights.- Ensure data quality, governance, and security best practices across all pipelines.- Troubleshoot and resolve data-related issues in production environments.- Automate workflows and improve efficiency using CI/CD pipelines.- Mentor junior engineers and provide technical https://jobeax.com/link/1N9F4ujaOnSRMas2 Skills & Qualifications : - 7+ years of hands-on experience in Data Engineering.- Strong expertise in PySpark for large-scale data processing.- Proficiency in SQL (query optimization, stored procedures, performance tuning).- Hands-on experience with Azure cloud services (ADF, Azure Data Lake, Synapse, Blob Storage, etc.)- Experience with Databricks (Delta Lake, Spark optimization, notebook workflows).- Knowledge of data modeling, ETL/ELT processes, and data warehousing.- Familiarity with Python, Shell scripting, and automation.- Understanding of CI/CD pipelines and DevOps practices (Git, Azure DevOps).- Strong problem-solving skills and ability to work in a fast-paced environment. (ref:hirist.tech)

Apply to vacancy

Similar vacancies

More like this role

RANDOMTREES PRIVATE LIMITED

RandomTrees - AWS DevOps Engineer

  • Remote
  • IT
  • DevOps
Role Overview : We are looking for an experienced AWS DevOps Engineer with strong hands-on expertise in Terraform, AWS infrastructure provisioning, GitLab CI/CD, and DevSecOps practices. The ideal candidate must have practical experience designing and provisioning AWS infrastructure using Terraform, developing reusable ...

Chennai, भारत

RANDOMTREES PRIVATE LIMITED

RandomTrees - SAP SD Consultant

... activities.- Perform functional testing, regression testing, defect resolution, and user acceptance testing.- Support IDoc/EDI interfaces and investigate errors in data exchange with external systems.- Collaborate with business stakeholders to gather requirements, analyze business processes, and deliver effective SAP SD solutions.- ...

Bangalore, भारत

IT Firm

Senior Data Analyst/Data Engineer

  • Full-time
  • Data Analytics
... opportunities.- Collaborate with data engineers and technical teams to ensure accurate implementation of business requirements.- Perform data validation, troubleshoot data-related issues, and ensure data accuracy and consistency.- Work with Databricks at a foundational level, including notebooks, data processing concepts, and data ...

Bangalore, भारत

Mindera

Senior Data Engineer

  • Full-time
Senior Data Engineer – Mindera At Mindera, we build technology products that create meaningful business impact. We work with modern cloud technologies and encourage engineering ownership, collaboration, continuous learning, and self-organization. Our Data Engineering teams build scalable, reliable, and high-performance ...

Chennai, भारत

Venpep Solutions

Senior Data Engineer

Rs 10 - 20 lakhs p.a.

Job Summary We are seeking an experienced Senior Data Engineer to lead the design, development, and optimization of scalable, secure, and high-performance data engineering solutions. The ideal candidate should have strong expertise in Python, SQL, Databricks, PySpark, Delta Lake, CDC, and incremental data processing. The ...

Coimbatore, भारत

Mindera

Senior Data Engineer

  • Full-time
Senior Data Engineer – Mindera At Mindera, we build technology products that create meaningful business impact. We work with modern cloud technologies and encourage engineering ownership, collaboration, continuous learning, and self-organization. Our Data Engineering teams build scalable, reliable, and high-performance ...

Bangalore, भारत

Okta

Senior Data Engineer

  • Hybrid
  • Full-time
... everyone has access to consistent and reliable data The Senior Data Engineer Opportunity Reporting to the manager of the Data Engineering Pipeline team, the senior data engineer will be a key player in ensuring the reliability and efficiency of our core data platform. This role is crucial, providing the stable data foundation ...

Bangalore, भारत

NationsBenefits, LLC

Senior Data Engineer

  • Full-time
... data accuracy and enable data-driven decision-making across the organization. The ideal candidate will possess a minimum of 6+ years of hands-on experience in data engineer on high-performing teams. Expertise in DBT, Airflow, Azure Databricks, SQL, Python, Py-spark, Automation is a must and knowledge of reporting tools is ...

Hyderabad, भारत

Okta

Senior Data Engineer

  • Hybrid
  • Full-time
... complex pipeline and infrastructure issues. - Manage the data onboarding lifecycle and integrate internal and external data sources. - Develop and deploy scalable data solutions using Snowflake, dbt, Airflow, and Terraform. - Advocate for modern technologies and best practices that improve data delivery and engineering efficiency. ...

Bangalore, भारत

Mahindra & Mahindra Ltd

Senior Data Engineer

... degree in: - Computer Science - Information Technology - Data Science - Engineering (any relevant discipline) Preferred: - Master's degree in Computer Science, Data Science, Information Systems, or related field. - Certifications in Cloud Platforms (Azure, AWS, GCP), Databricks, Snowflake, or Data Engineering. General Requirements ...

Bombay, भारत