Back to list

Vacancy description

Ganit - Senior Data Engineer - Python/Spark in Gurgaon, भारत

GANIT BUSINESS SOLUTIONS PRIVATE LIMITED

  • On-siteWork from the office

Gurgaon, भारत

Senior Data EngineerAbout GanitAt Ganit, we are not just data geeks - we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that push the boundaries of data https://jobeax.com/link/tIh845hdjJOTUnWw & Responsibilities:- Data Engineering Excellence: Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion.- Cloud Data Migration Leadership: Lead cloud migration projects, developing scalable Spark pipelines.- Medallion Architecture: Implement Bronze, Silver, and gold tables for scalable data systems.- Spark Code Optimization: Optimize Spark code to ensure efficient cloud migration.- Data Modeling: Develop and maintain data models with strong governance practices.- Data Cataloging & Quality: Implement cataloging strategies with Unity Catalog to maintain high-quality data.- Delta Live Table Leadership: Lead the design and implementation of Delta Live Tables (DLT) pipelines for secure, tamper-resistant data management.- Customer Collaboration: Collaborate with clients to optimize cloud migrations and ensure best practices in design and https://jobeax.com/link/Sh7ySWFJ4uCN3Tlw Qualifications:- Experience: Minimum 4 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects.- Education: Bachelors or higher degree in Computer Science, Data Engineering, or a related field.Skills:- Proficiency in Spark, SQL, Python, and other relevant data processing technologies.- Expertise in on-premises to cloud Spark code optimization and Medallion Architecture.- Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations.- Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus).Soft Skills:- Excellent communication and collaboration skills, with the ability to work effectively with clients and internal teams.Certifications:- AWS/GCP/Azure Data Engineer Certification. (ref:hirist.tech)

Similar vacancies

More like this role

GANIT BUSINESS SOLUTIONS PRIVATE LIMITED

Ganit Inc. - Senior Data Engineer - Medallion Architecture

  • On-site
Role : Senior Data EngineerAbout Ganit :At Ganit, we are not just data geeks - we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that ...

Gurgaon, भारत

... Query, etc.- Proficient in at least one programming language used in data engineering, such as Python (or Scala/Rust/Java).- Has strong execution knowledge of Data Modeling (star schema, snowflake schema, fact vs dimension tables).- Proficient in Spark and related applications like Databricks, GCP DataProc, AWS Glue, EMR, ...

Hyderabad, भारत

  • Full-time
Mid-level data science role at KreditBee in Bengaluru. Needs 2–4 years and a https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - ⁠ ⁠Develop various RestFul APIs & Integrate with various data sources - ⁠ ⁠Develop tools & techniques related to ETL - ⁠ ⁠Exposure in AWS or Other Cloud Platform is advantageous ...

Bangalore, भारत

  • On-site
  • Full-time
... your world, creating more fulfilling work and projects for our people and clients. For more information, visit [ Job Description We’re looking for a skilled Senior Data Engineer with strong experience in distributed systems, Python/Scala, and modern data engineering tools to help design and implement an end-to-end data ...

Hyderabad, भारत

  • Full-time
  • Contract
... utilization. WHO YOU ARE: - At least five years of experience in data engineering, DataOps, DevOps, or a comparable technical role. - Advanced hands-on experience with Python, PySpark, SQL, Git, and Databricks. - Strong experience with the Databricks ecosystem, including Delta Lake, Unity Catalog, and Databricks Serverless SQL. - ...

Bangalore, भारत

  • Full-time
... building data pipelines on AWS (Glue, EMR, Lambda, Step Functions) Strong SQL and experience with data warehousing (Redshift, dimensional modeling) Proficiency in Python or Scala for data engineering Experience with S3-based data lake architecture (partitioning, cataloging, formats like Parquet) Experience migrating data pipelines ...

Bangalore, भारत

Merrill Communications

Senior Data Engineer

  • Full-time
... - Ability to pull data from a wide variety of APIs using different strategies and methods Required Skills & Experience: - Azure Databricks & Apache Spark (PySpark) – Strong experience in building distributed data pipelines . - Python – Proficiency in writing optimized and maintainable Python code for data engineering. ...

Chennai, भारत

  • Remote
  • Hybrid
  • Full-time
  • Contract
... perfect your skills in a field filled with exciting challenges and opportunities. About the role As part of the Big Data B2B program, OBS set up a shared Big Data platform and a Data Lake for Use cases exploration and industrialization. We are looking for Senior Data Engineer 5-8 years of experience in building Data Pipelines ...

Gurgaon, भारत

  • Full-time
  • IT
... techniques to perform analyses - High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms - Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing ...

Pune, भारत

  • Full-time
... technologies. - 3+years of experience in consulting, with a focus on analytics and data solutions. - 2+ years of experience with Databricks, including Unity Catalog, Databricks SQL, Workflows, and Delta Sharing. - Proficiency in Python and Apache Spark. - Develop and manage Databricks notebooks for data transformation, exploration, ...

Ernakulam, भारत