4,051 big data developer jobs in India.

... retail banks, investment banks, broker-dealers & asset management firms, and insurance firms from leading Fortune 500 Companies. Within EY’s Consulting Practice, Data and Analytics team solves big, complex issues and capitalize on opportunities to deliver better working outcomes that help expand and safeguard the businesses, ...

... scalable. Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C# Data extraction across a wide variety of data sources Data cleaning, preprocessing, and transformation for further analysis by data analysts Data Validation framework from source to endpoints ensuring data quality and ...

... modules DSR DPIA RoPA Consent Vendor Risk Execute end to end DSR DSAR workflows and privacy operations Perform data discovery classification and scanning using BigID Build and maintain data inventory catalog and lineage Identify sensitive data and risks PII overexposure dark data Support RoPA DPIA and regulatory compliance ...

... of experience working in GCP-based Big Data deployments (both Batch and Real-Time), specifically leveraging BigQuery, Bigtable, Google Cloud Storage, Pub/Sub, Data Fusion, Dataflow, Dataproc, and Airflow. Data Design: Proven history of designing and delivering comprehensive data lake and data warehousing solutions. Data ...

... identify opportunities to integrate data/insights into decision-making. Understand and translate business requirements from internal and external stakeholders into data product and features. Process, cleanse, and verify the integrity of data used for analysis. Conduct exploratory data analysis to verify the initial hypothesis ...

... mapping rules between source-system data structures and SSPs standardised data models.- Support data profiling, quality assessment and resolution of source-system data issues.- Ensure data integrity throughout the integration lifecycle.4. Reconciliation & Exception Management :- Own transaction-level and data-flow reconciliation ...

... retail banks, investment banks, broker-dealers & asset management firms, and insurance firms from leading Fortune 500 Companies. Within EY's Consulting Practice, Data and Analytics team solves big, complex issues and capitalise on opportunities to deliver better working outcomes that help expand and safeguard the businesses, ...

... control and continuous integration.- In-depth knowledge of Salesforce architecture, data model, security, and platform capabilities.- Certification in Platform Developer I and II, or equivalent.- Minimum Salesforce Agentblazer Champion with experience delivering Agentforce agents with Data Cloud, preferred Salesforce Certified ...

... and maintain scalable data pipelines for data processing and transformation Build and manage workflow orchestration using Apache Airflow Develop and maintain data models and transformations using dbt Work with BigQuery or similar cloud data warehouses for data storage and querying Manage and interact with cloud object storage ...

... quality, and observability. Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals). - Create data aggregates & marts: Data modeling & contracts: Define schemas, data contracts, and ...

DATA ENGINEER EXPERIENCE - 5-8 yrs WORK MODE - HYBRID Data Pipeline Development : Design, build, and optimize scalable ETL/ELT pipelines to process and transform data from various sources into Snowflake. Data Modeling : Build and maintain data models within Snowflake for optimized querying and reporting. Cloud Infrastructure ...

... Behavior, Supply Chain, etc. - Exceptional SQL skills. - Experience with modern visualization tools like Tableau, Power BI, Domo, etc. - Knowledge of open-source, big data, and cloud infrastructure such as AWS, Hive, Snowflake, Presto, etc. - Experience with agile development methodologies. - Experience in retail or e-commerce ...

Opportunity Overview We are looking for a Data Engineer to build and optimize scalable data pipelines and analytical datasets on our AWS-based lakehouse platform. You will work with Apache Iceberg, AWS Glue, Athena, dbt, and Airflow to support reliable and efficient data processing for analytics and operational use cases. ...

... intelligent conversational interfaces. Role Overview: Position: Generative AI Chatbot & Azure Open AI with LLM and RAG Experience Required: 5+ years in GEN AI (Data Science) Location: Gurgaon /Bangalore /Hyderabad /Pune Employment Type: Permanent Notice Period: Preferred Immediate joiners Key Responsibilities: Design and ...

... Engineering, Data Science or a related field. 10+ years of hands-on experience in data engineering, with at least 5 years in a people management role leading data platform or data infrastructure teams. Deep expertise in data warehousing, data modeling (dimensional and Data Vault), ETL/ELT design and big data technologies. ...

... driven to deliver high quality data solutions that enable better decision making across the organization. This Data Engineer role will design, build, and maintain data pipelines and integrations across multiple source systems in a global environment. They develop ETL processes and APIs, manage data warehouse schemas, and ensure ...

... with demonstrated expertise in enterprise data management and related technologies - 5-10 years of data architecture experience - Thorough knowledge of Erwin Data Modeler - Thorough knowledge of data warehousing concepts and the ability to create a dimensional design - Strong understanding of data modeling best practices ...

... accountable for delivering exceptional results. Perform development work and technical support related to our data transformation and ETL jobs in support of a global data warehouse. Development of new ETL/data transformation jobs, using PySpark and IBM DataStage in AWS. Enhancement and support on existing ETL/data transformation ...

We are hiring for Senior Data Engineer (MS Fabric & Telecom) Work location: Bangalore, Karnataka, India Experince: 8 to 10 years Notice: Imdiate to 30 days only Role Overview As a Senior Data Engineer, you will be at the forefront of our data transformation, specifically architecting and building the next generation of ...

Pro Arch is seeking a Senior Data Engineer with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, ...