2,314 big data testing jobs in India.

... Purpose/ Summary We are looking for a skilled Data Engineer with 1-2 years of experience in designing, building, and maintaining scalable data pipelines and data platforms. The ideal candidate should have strong expertise in SQL, Databricks, and Azure Data Factory (ADF. and hands-on experience working with large datasets ...

... Preparation Product Area, focused on building the next generation of finance data and processing services The team builds on a lakehouse architecture using Azure Databricks, Azure Data Factory and Azure Data Lake (Delta Lake) with Python being the main programming language and PySpark is used for large scale data engineering. ...

• Hybrid
• On-site

90k

... Productionise AI/ML: guide feature engineering, model deployment, monitoring, versioning, explainability and MLOps workflows. Establish and enforce CI/CD, automated testing, observability and incident response for data pipelines, models and analytics services. Define and enforce data governance, security, privacy and compliance ...

... unstructured sources into cloud data platforms. - Create responsive and high-performance user interfaces using https://jobeax.com/link/6WcBICn0LM558SP0 , enabling rich data visualizations and seamless user interactions. - Work with Big Data technologies and cloud data warehouses (e.g., BigQuery, Snowflake) to ensure efficient data ...

• Contract

... - Solid understanding of data pipeline fundamentals, including ingestion, transformation, and loading (ETL/ELT) processes. - Must have experience with batch data processing (scheduling, dependencies, failure recovery, performance tuning). - Knowledge of data warehousing concepts and familiarity with relational databases. ...

... etc. Bachelor's or Master's degree in Computer Science/Information Systems. At least 4+ years of experience in building data flow and data management on a modern big data tech stack. Strong experience in using ETL frameworks (e. g., Airflow, Jenkins) to build and deploy production-quality ETL pipelines. Knowledge of data structures. ...

... etc Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities. Experience handling un-structured data, working in a data lake environment, leveraging data streaming and developing data pipelines driven ...

... performance tuning, and working with large relational datasets - Experience building and maintaining ETL/ELT pipelines and working with structured and semi structured data - Understanding of data modelling concepts (e.g. relational, dimensional, and/or big data modelling) - Strong understanding of DevOps/CI/CD concepts and tooling ...

• Contract

... Experience with AI/ML-driven systems testing, including validating model outputs, testing non-deterministic systems (e.g., LLM-based features), and understanding of data quality, drift, and bias considerations.- Knowledge of event-driven architectures (Kafka, messaging systems) and testing strategies.- Exposure to security testing ...

• Hybrid

... detection, and personalized financial services. You will collaborate closely with product managers, software engineers, and business stakeholders to translate ambiguous financial data into scalable, production-grade models. By deploying high-impact algorithms, you will directly influence our core business metrics, ensuring ...

... governance principles, data quality checks on each data layer. - A successful history of manipulating, processing and extracting value from large disconnected datasets. - Working knowledge of message queuing, stream processing, and highly scalable big data data stores. - Strong project management and organizational skills. ...

... and mitigate data risks throughout the data lifecycle, including protection, retention, storage, use, and quality l Partner with technology teams to capture data sources, formats, and data flows so that data can be validated for downstream analytics and reporting l Investigate and document potential data quality issues, ...

• Hybrid

... vector-based data pipelines for AI and GenAI use cases Develop scalable batch and streaming data pipelines using cloud-based data platforms (e.g., Snowflake or Databricks) Create and evolve semantic data models that transform raw data into analytics-ready, trustworthy datasets Build data preprocessing, validation, and quality-assurance ...

Rs 5 - 10 lakhs p.a.

... Behavior, Supply Chain, etc. - Exceptional SQL skills. - Experience with modern visualization tools like Tableau, Power BI, Domo, etc. - Knowledge of open-source, big data, and cloud infrastructure such as AWS, Hive, Snowflake, Presto, etc. - Experience with agile development methodologies. - Experience in retail or e-commerce ...

... Participate in code reviews and contribute to maintaining high code quality standards. Engage in the entire software development lifecycle, from design and testing to deployment and maintenance. Collaborate closely with cross-functional teams to align messaging, contribute to roadmaps, and integrate software into different ...

• On-site
• Full-time
• Contract

₹150 INR

... 2-3 years as Data/Backend Engineer with PM work (PRDs, roadmaps, user research) Technical Stack Depth Deep understanding: ETL/ELT pipelines, data warehousing, data lakes/lakehouses Advanced SQL (query optimization, not just SELECT statements) Hands-on with ONE of: Hive/Spark/Hadoop/HDFS, Snowflake/Databricks/BigQuery, or ...

... queries for large-scale and big data environments. Proficiency with BI and visualization platforms including Tableau, Power BI, QlikView. Hands-on experience with Databricks, Microsoft Fabric, Cloudera Hadoop, SQL Server, and big data technology stacks. Experience working with cloud platforms such as AWS and Azure. Programming ...

... architectures like RNNs and LSTM , BERT Should have worked with cognitive services from major cloud platforms like AWS and have a working knowledge of SQL and no-SQL databases. Ability to create data and ML pipelines for more efficient and repeatable data science projects using MLOps principles Keep abreast with new tools, algorithms ...

• Hybrid

... and lending operations. Ensure accurate lending data integration across upstream and downstream systems. Risk & Regulatory Reporting Support enterprise risk data platforms and regulatory reporting initiatives. Perform data validation, reconciliation, and controls testing to meet compliance requirements. Partner with Risk, ...

• Remote
• Part-time
• Contract

$8 USD / hour

... English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves Annotation is what helps AI ...