225 big data developer jobs in Gurugram, India.

About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...

... maintainable code following software engineering best practices and coding standard. Optimize application performance, scalability, and reliability for high-volume data processing workloads. Implement automated testing, including unit test cases using pytest. Collaborate with front end developers to support seamless integration ...

... all phases of the software development lifecycle (SDLC) - Conduct code reviews/peer reviews/desk checks, identify areas for improvement, and mentor junior developers - Ensure code quality, performance, and scalability of applications - Analyze and troubleshoot complex technical issues as needed Skills and Qualification ...

Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...

• Remote

... modeling) and modern AI systems (LLMs, Generative AI and agentic frameworks). The role requires strong applied modeling skills across structured and unstructured data, and experience deploying models into production environments. This position involves end-to-end ownership of data science initiatives, from problem framing and ...

... well-documented code that others can understand and maintain All About You passionate about using data visualisations to tell stories 1–3 years experience in creating data visualisations proficient in R or Python proficient in using code to clean data, transform, and aggregate data familiar with version control concepts and tools ...

... solutions for our clients. Instead, you'll be out in the open water, shaping the future with brilliant minds. We are looking for a Lead Data Scientist who can own data science engagements end to end, from shaping the problem with the client to delivering and operationalizing ML solutions. You will lead a team of data scientists, ...

... data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog ...

... capture the most granular data. Align the engineering and product teams on the Data Granularity and accuracy requirements. Build Alerts to detect bugs in the data pipeline. Perform data analysis to test hypothesis and uncover factor influencing metric variations Build Feature Store for Data Science implementations Overall ...

... https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, and evaluating state-of-the-art machine ...

• On-site

... fundamentals and engineering principles, with hands-on experience in big data technologies such as Scala and Spark. The role involves working with cloud or on-premises data infrastructure and contributing to the design and development of robust, scalable data pipelines and solutions. Key Responsibilities: - Design and develop scalable ...

... workflows, and structured output pipelines for LLM applications. Fine-tune, evaluate, and optimize LLM-powered applications for accuracy, latency, and cost. Implement data preprocessing, feature engineering, and ML model training workflows. Work with structured and unstructured datasets to solve business problems. Collaborate with ...

... with requirements gathering and stakeholder interviews.- Strong analytical and problem-solving https://jobeax.com/link/D1cYk5JWAvbfErTV Stack/Understanding :- Data Catalogs- Metadata Management- Data Quality- Data Governance Frameworks- Advanced Excel, PowerPoint, and reporting https://jobeax.com/link/Cexs453KRiH2S1rJ Qualifications ...

• Remote
• Hybrid

... dashboards that visualize key performance indicators, enabling management to monitor business health in real-time.- Partner with internal business units to translate ambiguous requirements into structured data models and analytical frameworks that solve critical operational challenges.- Conduct deep-dive exploratory data analysis ...

... you will do :- Translate business questions into clear metrics and an analysis plan.- Prepare and analyse large datasets using SAS, SQL and Python.- Reconcile data sources, validate calculations and investigate discrepancies.- Identify what is driving performance and recommend actions supported by the data.- Deliver findings ...

... organization, with direct involvement in achieving/maintaining the Data & AI (Azure) Solutions Partner designation, and hands-on contribution to passing the Microsoft Data & AI specialization audit.- Strong expertise in Azure Data Lake Storage, Azure Synapse Analytics, Microsoft Fabric, and/or Azure Databricks.- Experience with ...

... members. We are seeking experienced Data Engineering professionals with 4–6 years of hands-on expertise in Big Data technologies, with a focus on building scalable data solutions using Google Cloud Platform (GCP). Key Skills & Experience: Strong programming skills in Python and Bash Solid understanding of SQL and data warehousing ...

... Analysis.- Experience with requirements gathering and stakeholder interviews.- Strong analytical and problem-solving https://jobeax.com/link/D1cYk5JWAvbfErTV Stack:- Data Catalogs- Metadata Management- Data Quality- Data Governance Frameworks- Advanced Excel, PowerPoint, and reporting https://jobeax.com/link/Cexs453KRiH2S1rJ Qualifications ...

Must-Have Skills :- 9+ years of relevant experience in Data Engineering and project delivery.- Strong expertise in Big Data concepts and cloud implementation projects.- Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).- Excellent hands-on experience with Python, PySpark, and ...

... https://jobeax.com/link/FfDHiV3kuJ7mhqWK Architecture & Advisory : - Own end-to-end Snowflake architecture for enterprise-scale programs.- Translate business goals into data platform strategies (lakehouse / data warehouse / modern data stack).- Design solutions across data ingestion, transformation, orchestration, modelling, and consumption ...