2,275 big data testing jobs in India.

Rs 22 - 60 lakhs p.a.

... accessibility and usability. Troubleshoot data-related issues and optimize data processing workflows. Skills and Qualifications - Bachelor's degree in Computer Science, Data Science, Statistics, or a related field. - 8-15 years of experience in data analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. ...

... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...

... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...

• On-site

... and results-driven Data Engineer to join our growing Data Engineering team. You will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making for our clients. This role is ideal for someone who thrives in a consulting environment, enjoys solving complex data challenges, ...

... Design, Performance Tuning.- Data Integration : Apache Kafka, AWS DMS, REST APIs, CDC.- Metadata & Governance : Apache Atlas (preferred), Metadata Management, Data Catalog, Business Glossary, Data Lineage, Data Stewardship, Data Quality.- Business Intelligence : Tableau, Semantic Layer, KPI Frameworks, Data Mart Design, ...

Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...

Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...

• Remote

10k - 33k

... or Azure environments Python & scripting for automation and data processing Data streaming technologies (Kafka, Spark, Flink) Big Data platforms (Snowflake, Databricks, Hadoop, Teradata) Exposure to AI/ML and advanced analytics Experience with NoSQL databases Ability to design scalable and maintainable data architectures. ...

... Modelling, OLAP cube modelling.- Data compression into PARQUET to improve processing and finetuning SQL programming skills.- Experience building and optimizing "big data" data pipelines, architectures and data sets.- Experience performing root cause analysis on internal and external data and processes to answer specific business ...

• Full-time

... insights. - Manage data connections and publish governed data sources through Tableau Server/Cloud . - Configure appropriate security, user access, permissions, and data-source settings. - Ensure data accuracy, integrity, consistency, and governance across BI assets. - Troubleshoot dashboard, data, performance, and connectivity ...

... prediction and forecasting tasks on tabular/text datasets. - Collaborate with cross-functional teams to understand business requirements and translate them into data-driven solutions. - Perform data preprocessing, feature engineering, and exploratory data analysis (EDA) to support model development. - Build and deploy end-to-end ...

• Hybrid

... including data structures, algorithms, concurrency, and system design. - Strong understanding of software development best practices, including CI/CD, automated testing, code review, and observability. - Proficiency in SQL and data modeling. - Strong understanding of ETL processes, data warehousing, and data governance principles. ...

1400

... Azure Data Factory or equivalents) - Understanding of data integration patterns (APIs, ingestion pipelines, transformation layers) and Solid understanding of data modelling (star schema, dimensional modelling, data warehousing concepts) - Knowledge of data quality, testing, and observability practices (monitoring, validation, ...

Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...

... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...

... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...

... root cause analysis to improve data quality. Data Governance Define and implement data governance frameworks, policies, and standards. Ensure compliance with data quality, data privacy, and regulatory requirements. Establish data lineage, metadata management, and data stewardship practices. Monitor and improve data quality ...

• Full-time

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. AWS AI Services Minimum 3 Year(s) ...

• Full-time

... production support activities as required. - Work with cross-functional and global teams to coordinate technical deliverables and project dependencies. - Support testing, deployment, release, and post-implementation activities. - Ensure solutions follow appropriate security, compliance, governance, and operational standards ...

• Full-time

Rs 25 - 30 lakhs p.a.

... mentor data scientists, and contribute to the design and evolution of machine learning systems. Requirements Key Responsibilities - Lead the design, development, testing, and deployment of advanced data science and machine learning models to solve complex business problems. - Develop robust data science solutions using Python ...