379 big data engineer jobs in Gurugram, India.

About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...

• On-site

... who enjoys solving real engineering problems and writing clean, scalable code. The ideal candidate will have a solid foundation in coding fundamentals and engineering principles, with hands-on experience in big data technologies such as Scala and Spark. The role involves working with cloud or on-premises data infrastructure ...

... members. We are seeking experienced Data Engineering professionals with 4–6 years of hands-on expertise in Big Data technologies, with a focus on building scalable data solutions using Google Cloud Platform (GCP). Key Skills & Experience: Strong programming skills in Python and Bash Solid understanding of SQL and data warehousing ...

Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...

... tools to streamline data engineering workflows. Collaborate across teams to facilitate smooth data flow and integration. Enforce best practices in observability, data governance, security, and regulatory compliance Minimum 7 years as a Data Engineer or similar role. Hands-on experience with Databricks, Delta Lake, Spark, and ...

2400

... building the REST APIs and web UIs needed to make this data available in a performant and reliable way. We build services in Python and React. This role suits an engineer who is accountable, collaborative, and comfortable moving between data, backend, and frontend work. There will be opportunities to engage with and learn from ...

• Remote

... projects in environments with evolving requirements and timelines. Required Qualifications, Experience & Skills: Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, Engineering, or a related quantitative field. Experience: - 3+ years of professional experience in data science or applied machine ...

... through the company's product suites About The Role We are looking for a Data Scientist to join Mastercard's Economics Institute, reporting to the team lead for Data Systems Engineering. An individual who will: create clear, compelling data visualisations that communicate economic insights to diverse audiences develop reusable ...

... components, including Azure Data Lake Storage, Databricks Delta Lake, and Azure DevOps. Develop reusable, modular, and maintainable code following software engineering best practices and coding standard. Optimize application performance, scalability, and reliability for high-volume data processing workloads. Implement automated ...

... data science and ML, with at least 2 years leading projects or teams in a pharma consulting or client-facing setting. - A Bachelor's or Master's degree in engineering, statistics, mathematics or a relevant quantitative field. - Experience with life sciences data, such as claims (Komodo, IQVIA, Symphony), specialty pharmacy, ...

... capture the most granular data. Align the engineering and product teams on the Data Granularity and accuracy requirements. Build Alerts to detect bugs in the data pipeline. Perform data analysis to test hypothesis and uncover factor influencing metric variations Build Feature Store for Data Science implementations Overall ...

... https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, and evaluating state-of-the-art machine ...

... Product Owners, Business SMEs, Engineering teams, and other stakeholders to translate business requirements into scalable technical solutions. Google Cloud & Data Engineering Expertise Hands-on experience with Google's data ecosystem, including: BigQuery Dataproc Dataflow Pub/Sub BigTable Cloud Spanner Cloud SQL AlloyDB ...

... applications for accuracy, latency, and cost. Implement data preprocessing, feature engineering, and ML model training workflows. Work with structured and unstructured datasets to solve business problems. Collaborate with Product Managers, Software Engineers, and Subject Matter Experts to deliver AI-driven features. Monitor model ...

... with requirements gathering and stakeholder interviews.- Strong analytical and problem-solving https://jobeax.com/link/D1cYk5JWAvbfErTV Stack/Understanding :- Data Catalogs- Metadata Management- Data Quality- Data Governance Frameworks- Advanced Excel, PowerPoint, and reporting https://jobeax.com/link/Cexs453KRiH2S1rJ Qualifications ...

• Remote
• Hybrid

... technical insights into intuitive dashboards that drive decision-making for senior leadership. You will collaborate closely with cross-functional product, engineering, and operations teams to identify performance bottlenecks, optimize data workflows, and ensure data integrity across our RDBMS ecosystem. Your work will ...

... you will do :- Translate business questions into clear metrics and an analysis plan.- Prepare and analyse large datasets using SAS, SQL and Python.- Reconcile data sources, validate calculations and investigate discrepancies.- Identify what is driving performance and recommend actions supported by the data.- Deliver findings ...

... organization, with direct involvement in achieving/maintaining the Data & AI (Azure) Solutions Partner designation, and hands-on contribution to passing the Microsoft Data & AI specialization audit.- Strong expertise in Azure Data Lake Storage, Azure Synapse Analytics, Microsoft Fabric, and/or Azure Databricks.- Experience with ...

... Analysis.- Experience with requirements gathering and stakeholder interviews.- Strong analytical and problem-solving https://jobeax.com/link/D1cYk5JWAvbfErTV Stack:- Data Catalogs- Metadata Management- Data Quality- Data Governance Frameworks- Advanced Excel, PowerPoint, and reporting https://jobeax.com/link/Cexs453KRiH2S1rJ Qualifications ...

... Analytics.- Drive account growth through cross-selling and innovation-led https://jobeax.com/link/OZWsErPURNpr0waD Excellence & Mentorship : - Mentor architects and engineers across projects.- Build strong internal communities around Snowflake, dbt/modern data stack, and cloud-native data engineering.- Promote best practices in ...