2,313 big data testing jobs in India.

... scalable. Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C# Data extraction across a wide variety of data sources Data cleaning, preprocessing, and transformation for further analysis by data analysts Data Validation framework from source to endpoints ensuring data quality and ...

... driven to deliver high quality data solutions that enable better decision making across the organization. This Data Engineer role will design, build, and maintain data pipelines and integrations across multiple source systems in a global environment. They develop ETL processes and APIs, manage data warehouse schemas, and ensure ...

• Hybrid
• Full-time

... including generative AI and LLM-based approaches — using enterprise business data, knowledge graphs, business process intelligence, and structured and unstructured data assets. - Learn SAP's deep data and process context — data models, metadata structures, and business process semantics across Order-to-Cash, Procure-to-Pay, Record-to-Report, ...

Required - 3–7 years of Data/Cloud Engineering experience with hands-on GCP . - Strong SQL and Python skills. - Experience with Spanner, BigQuery and batch/streaming pipelines . - Good understanding of GCP IAM, monitoring, logging and production support. - Strong troubleshooting mindset and ability to ramp up quickly in ...

• Remote
• Hybrid
• Full-time

... monitoring, logging, alerting, incident response, and clean CI/CD via Azure DevOps. - Translate ambiguous business asks into reliable, documented, maintainable data products. 3+ years in data engineering, with significant Spark / PySpark at production scale. - Strong SQL and dimensional data modeling (Kimball-style star schemas, ...

... Design and develop batch and real-time data pipelines on GCP.- Build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer.- Ingest data from databases, APIs, files, SaaS applications, and streaming sources.- Design and optimize BigQuery datasets, tables, partitioning, and clustering.- Develop data transformations ...

• Contract

... strong Data Analyst background with the ability to work with Excel, SQL, web-scraped data, and databases , while also being comfortable supporting basic cloud database, software, and data-related troubleshooting activities . Since the application relies heavily on accurate data, the candidate should be able to identify data-related ...

• Hybrid

... across technical and non-technical stakeholders. Preferred Qualifications - Experience with containerization technologies (Docker, Kubernetes). - Knowledge of data pipelines, data warehousing, or big data tools. - Familiarity with monitoring tools and performance optimization techniques. What’s in it for you? Pathways for ...

... and maintain scalable data pipelines for data processing and transformation Build and manage workflow orchestration using Apache Airflow Develop and maintain data models and transformations using dbt Work with BigQuery or similar cloud data warehouses for data storage and querying Manage and interact with cloud object storage ...

... pgsql, tsql, plsql- Working knowledge on Data loads, ETL and data migrations- Expertise in building complex stored procedures, functions- Should have exp in database auditing and identifying performance bottle necks.- Good understanding on application lifecycle.- Expertise in database setup, user management & deployments- ...

• Hybrid

... quality, and observability. Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals). - Create data aggregates & marts: Data modeling & contracts: Define schemas, data contracts, and ...

• Hybrid

DATA ENGINEER EXPERIENCE - 5-8 yrs WORK MODE - HYBRID Data Pipeline Development : Design, build, and optimize scalable ETL/ELT pipelines to process and transform data from various sources into Snowflake. Data Modeling : Build and maintain data models within Snowflake for optimized querying and reporting. Cloud Infrastructure ...

Opportunity Overview We are looking for a Data Engineer to build and optimize scalable data pipelines and analytical datasets on our AWS-based lakehouse platform. You will work with Apache Iceberg, AWS Glue, Athena, dbt, and Airflow to support reliable and efficient data processing for analytics and operational use cases. ...

... intelligent conversational interfaces. Role Overview: Position: Generative AI Chatbot & Azure Open AI with LLM and RAG Experience Required: 5+ years in GEN AI (Data Science) Location: Gurgaon /Bangalore /Hyderabad /Pune Employment Type: Permanent Notice Period: Preferred Immediate joiners Key Responsibilities: Design and ...

• Remote
• Hybrid
• On-site

... with demonstrated expertise in enterprise data management and related technologies - 5-10 years of data architecture experience - Thorough knowledge of Erwin Data Modeler - Thorough knowledge of data warehousing concepts and the ability to create a dimensional design - Strong understanding of data modeling best practices ...

90k

... Shield key processes and know-how on Statistical and ML Guarantee highest ML utilization Education: Mathematics/Physics/Engineering with a master's in business/data analytics or proven track record on Data Science Proven track record of minimum 5 years as a data scientist Coding capabilities in R and/or Phyton Relationship/ ...

... accountable for delivering exceptional results. Perform development work and technical support related to our data transformation and ETL jobs in support of a global data warehouse. Development of new ETL/data transformation jobs, using PySpark and IBM DataStage in AWS. Enhancement and support on existing ETL/data transformation ...

We are hiring for Senior Data Engineer (MS Fabric & Telecom) Work location: Bangalore, Karnataka, India Experince: 8 to 10 years Notice: Imdiate to 30 days only Role Overview As a Senior Data Engineer, you will be at the forefront of our data transformation, specifically architecting and building the next generation of ...

Rs 1.5 - 4 lakhs p.a.

... unstructured data ingestion at scale (volume, variety, velocity). Implement CI/CD pipelines and follow Data Ops practices for automation and reliability. Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads. Ensure high-quality solutions through unit testing frameworks and automated validation. ...

... Tosca, API/Integration Testing, SQL, and Test https://jobeax.com/link/HNHKJJ2Xvi7ngDKq candidate will be responsible for automating functional and regression testing, validating APIs and data, troubleshooting defects, and supporting high-quality releases across enterprise applications and data https://jobeax.com/link/97UklDXxZbVngXCw ...