2,314 big data testing jobs in India.

• Hybrid

... pipelines. - Strong SQL and solid Python — the everyday tools of this role. - Experience with ETL/ELT and orchestration tools such as Airflow, dbt, Glue, or Data Factory. - Hands-on experience with a cloud data warehouse such as Snowflake, Redshift, BigQuery, or ClickHouse, including data modeling for analytics. - Experience ...

... FireHose, Lambda, and IAM roles and permissions - Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases) - Experience with dbt (data build tool) for transformation layer management and semantic modeling. - Familiarity with data lakehouse ...

... transformation, and loading (ETL) of data. Your responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. ...

Rs 0.5 - 4 lakhs p.a.

... PySpark, or PL/SQL Hands-on experience with cloud platforms (e.g., AWS, S3, Redshift, Glue, etc.) Familiarity with distributed systems (e.g., Hadoop, Spark), NoSQL databases, and cloud data warehouses (e.g., Snowflake, BigQuery) Personal Attributes Strong problem-solving and analytical skills Entrepreneurial mindset and initiative-driven ...

... delivery with technical excellence.- Create technology and tool evaluation https://jobeax.com/link/nRhKJdDFbgW6SVjl Requirements : - Strong hold on Algorithms and Data Structures.- Exposure to C/C++ programming, STL, and Linux.- Experience in writing multi-threaded applications with good scalability.- Exposure to Exception Handling, ...

... drill-down dashboards enabling business leaders to analyze trends and root https://jobeax.com/link/xO27IwB87boM1kxT Engineering & Automation : - Consolidate data from Excel, CSV, databases, APIs, SharePoint, and business systems.- Develop reusable data models and reporting pipelines.- Automate data collection, cleansing, ...

... analytics, BI self-service and AI use cases.- Databricks Workflows) and compute engines (Spark, SQL, Python).- Data Quality, Governance & Observability : - Implement data quality checks, validations, and monitoring to ensure reliability and trust in data products.- Contribute to data lineage, metadata management, and documentation.- ...

• Hybrid

... data ecosystems—where data resides, flows, and how it is accessed. - Troubleshoot and resolve complex technical issues related to collaboration platforms and data access. - Support investigations, audits, and regulatory requests through targeted data retrieval and analysis. - Automate data processes and workflows using ...

... Cloud Platform (GCP).- Good understanding of ETL/ELT, data pipelines, and distributed data processing.- Experience with one or more GCP data services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, or Composer.- Strong SQL and database knowledge.- Understanding of cloud-native and distributed data architectures.- Strong ...

₺4 TRY

... systems for seamless operations. Develop optimized workflows to improve efficiency and reduce downtime. Drive full project lifecycle: blueprinting, prototyping, testing, data migration, go-live, and post-go-live support. Conduct training workshops for end-users and IT teams. Monitor system performance and recommend continuous ...

... Teradata, Python and Julia.- The candidate must have experience in Python and Julia for data processing, analysis and automation.- 2-4 years of experience in Teradata, Python, and Julia.- Strong experience in data engineering and data analytics.- Good knowledge of Provider domain.- Experience working with Teradata databases.- ...

... multiple data sources, and building semantic data layers for analytics and https://jobeax.com/link/eQK4uag79A3cPnLy Responsibilities :- Design and develop scalable data virtualization solutions using Denodo.- Create and maintain Base Views, Derived Views, Joins, Unions, Interfaces, and Data Services.- Integrate data from multiple ...

Rs 4.5 - 5.5 lakhs p.a.

... datasets and ensure strong data contracts. Support production operations, including on-call rotations for critical pipelines as needed. Hands-on expertise in GCP data stack: BigQuery, Dataflow (Apache Beam), Dataproc, Cloud Storage, Pub/Sub, Cloud Composer (Airflow). Advanced SQL and data modeling: star/snowflake schemas, slowly ...

Rs 1 - 5 lakhs p.a.

... Drive end-to-end insights creation-to-consumption lifecycle, leading business problem definition, designing and delivering the solutions. Oversee the mapping of data sources, data movement with the goal of ensuring data quality. Active participation in the trouble shooting issues including root cause analysis. Designing documents ...

... analytics, ClickHouse for high-throughput operational and real-time dashboards, and BigQuery exposure where applicable. Workflow Orchestration: Airflow for scheduled data pipelines, DQ/reconciliation DAGs, backfills, and SLA-driven jobs; Temporal for durable workflow execution in ingestion services. Data Quality & Governance: DQ ...

Role: Data Engineer - Power BI Modelling Level: 7-15 years Build and maintain Power BI semantic models (DAX, star schemas) for enterprise reporting. Develop PySpark/Python and SQL pipelines feeding the Snowflake environment. Translate reporting requirements into performant data models. Ensure data quality. Validate accuracy ...

... Hands-on experience with cloud platforms (AWS, GCP, Azure) and data services (e.g., Redshift, BigQuery, Snowflake, Databricks). Familiarity with workflow orchestration tools (Airflow, Luigi, Dagster) and CI/CD pipelines. Solid understanding of software engineering best practices (version control, testing, code reviews).

... delivery with technical excellence.- Create technology and tool evaluation https://jobeax.com/link/nRhKJdDFbgW6SVjl Requirements : - Strong hold on Algorithms and Data Structures.- Exposure to C/C++ programming, STL, and Linux.- Experience in writing multi-threaded applications with good scalability.- Exposure to Exception Handling, ...

• Remote
• Part-time
• Contract

$30 USD / hour

... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...

... written and verbal communication skills in English. Experience with cloud technologies and distributed systems. Experience with data transformation frameworks and data pipeline orchestration tools. Experience managing large volumes of data and optimizing data processing. Understanding of event-based architecture, data streaming, ...