Back to list

Vacancy description

RandomTrees - Senior Data Engineer - PySpark/Azure Databricks in Hyderabad, भारत

RANDOMTREES PRIVATE LIMITED

Hyderabad, भारत

About the Job : We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).You will be responsible for developing efficient data solutions, optimizing workflows, and ensuring data reliability to support business https://jobeax.com/link/nEC7Pw3JSppzjDvo Responsibilities : - Design, develop, and deploy high-performance data pipelines using PySpark, Databricks, and Azure Data Factory (ADF).- Optimize and maintain SQL queries, stored procedures, and ETL processes for large-scale data processing.- Work with Azure cloud services (Azure Data Lake, Azure Synapse, Blob Storage, etc.) to build scalable data solutions.- Implement data integration, transformation, and warehousing solutions in Databricks.- Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver actionable insights.- Ensure data quality, governance, and security best practices across all pipelines.- Troubleshoot and resolve data-related issues in production environments.- Automate workflows and improve efficiency using CI/CD pipelines.- Mentor junior engineers and provide technical https://jobeax.com/link/1N9F4ujaOnSRMas2 Skills & Qualifications : - 7+ years of hands-on experience in Data Engineering.- Strong expertise in PySpark for large-scale data processing.- Proficiency in SQL (query optimization, stored procedures, performance tuning).- Hands-on experience with Azure cloud services (ADF, Azure Data Lake, Synapse, Blob Storage, etc.)- Experience with Databricks (Delta Lake, Spark optimization, notebook workflows).- Knowledge of data modeling, ETL/ELT processes, and data warehousing.- Familiarity with Python, Shell scripting, and automation.- Understanding of CI/CD pipelines and DevOps practices (Git, Azure DevOps).- Strong problem-solving skills and ability to work in a fast-paced environment. (ref:hirist.tech)

Apply to vacancy

Similar vacancies

More like this role

RANDOMTREES PRIVATE LIMITED

RandomTrees - AWS DevOps Engineer

  • Remote
  • IT
  • DevOps
Role Overview : We are looking for an experienced AWS DevOps Engineer with strong hands-on expertise in Terraform, AWS infrastructure provisioning, GitLab CI/CD, and DevSecOps practices. The ideal candidate must have practical experience designing and provisioning AWS infrastructure using Terraform, developing reusable ...

Chennai, भारत

RANDOMTREES PRIVATE LIMITED

RandomTrees - SAP SD Consultant

... activities.- Perform functional testing, regression testing, defect resolution, and user acceptance testing.- Support IDoc/EDI interfaces and investigate errors in data exchange with external systems.- Collaborate with business stakeholders to gather requirements, analyze business processes, and deliver effective SAP SD solutions.- ...

Bangalore, भारत

IT Firm

Senior Data Analyst/Data Engineer

  • Full-time
  • Data Analytics
... opportunities.- Collaborate with data engineers and technical teams to ensure accurate implementation of business requirements.- Perform data validation, troubleshoot data-related issues, and ensure data accuracy and consistency.- Work with Databricks at a foundational level, including notebooks, data processing concepts, and data ...

Bangalore, भारत

Senior Data Engineer

  • Remote
  • Full-time
... Group, and/or Division level). The Senior Data Engineer , CCG IT, is responsible for working in partnership with IT, ETO, and business functions to understand data requirements and translate them into technical solutions. This includes ensuring proper design, implementing robust data pipelines, performing data modeling and ...

Hyderabad, भारत

Avathon

Senior Data Engineer

  • On-site
... large-scale data platforms, with at least 2 years of experience leading or mentoring data engineers. - Hands-on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka. - Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses. - Extensive ...

Bangalore, भारत

Metropolis

Senior Data Engineer

  • On-site
... most valuable asset, time. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact ...

Bangalore, भारत

Mindera

Senior Data Engineer

  • Full-time
Senior Data Engineer – Mindera At Mindera, we build technology products that create meaningful business impact. We work with modern cloud technologies and encourage engineering ownership, collaboration, continuous learning, and self-organization. Our Data Engineering teams build scalable, reliable, and high-performance ...

Chennai, भारत

Venpep Solutions

Senior Data Engineer

Rs 10 - 20 lakhs p.a.

Job Summary We are seeking an experienced Senior Data Engineer to lead the design, development, and optimization of scalable, secure, and high-performance data engineering solutions. The ideal candidate should have strong expertise in Python, SQL, Databricks, PySpark, Delta Lake, CDC, and incremental data processing. The ...

Coimbatore, भारत

Mindera

Senior Data Engineer

  • Full-time
Senior Data Engineer – Mindera At Mindera, we build technology products that create meaningful business impact. We work with modern cloud technologies and encourage engineering ownership, collaboration, continuous learning, and self-organization. Our Data Engineering teams build scalable, reliable, and high-performance ...

Bangalore, भारत

Okta

Senior Data Engineer

  • Hybrid
  • Full-time
... everyone has access to consistent and reliable data The Senior Data Engineer Opportunity Reporting to the manager of the Data Engineering Pipeline team, the senior data engineer will be a key player in ensuring the reliability and efficiency of our core data platform. This role is crucial, providing the stable data foundation ...

Bangalore, भारत