2,468 big data python jobs in India.

• Hybrid
• On-site

... modelling depth — you can design a canonical model across messy sources and defend the decisions behind it. - Production pipeline engineering — Spark or equivalent, Python, strong SQL, and orchestration with Airflow or similar. - Data quality and governance in practice — validation frameworks, lineage and reconciliation. Not as ...

80k

... management plans and documentation, ensuring compliance with industry standards and regulatory requirements. - Participate in the identification and resolution of data discrepancies and issues, working to streamline data flow and enhance data quality throughout the study lifecycle. - Collaborate closely with cross-functional ...

• Full-time

... and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management ...

• Full-time
• Contract

... understanding of deep neural networks and other machine learning techniques in high frequency domain is a plus. Comfortably making pragmatic modeling tradeoffs under ambiguity while clearly articulating the reasoning behind them with data. By submitting this application, you acknowledge and consent to terms of the WorldQuant Privacy ...

... development - Expertise in building Azure-based data pipelines, including: - Azure Data Factory / Synapse - DataBricks / Synapse Spark Pool - Cosmos DB - Azure Data Lake Storage (ADLS) - Dedicated SQL Pool / Azure SQL - Azure Logic Apps - Hands-on experience with data transformation and cleansing using Spark, Python, R, SQL ...

• Hybrid

Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...

... Engineering & Development Strong Python and SQL programming skills Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data models Experience integrating complex data sources: Oracle DB, SQL Server, Azure SQL DB, file systems, Salesforce, APIs Strong data modelling skills: relational, ...

• Full-time

Data Science Data Engineer Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. ...

• Hybrid

... data pipelines and ETL workflows on AWS.- Develop efficient data processing solutions using python and pySpark.- Write complex and optimized SQL queries for data extraction, transformation, and analysis.- Build and manage ETL pipelines using AWS Glue.- Work with AWS Glue Data Catalog for metadata management and data discovery.- ...

... techniques. Hands-on experience integrating and optimizing Starburst/Trino, including connecting Starburst from Lambda and Glue ETL jobs. Experience with NoSQL databases such as DynamoDB, MongoDB. Experience working with data formats including Avro, Parquet, JSON, XML, and CSV. Comfortable challenging your peers and leadership ...

... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...

... S3, AWS Glue, Athena, Redshift Experience designing cloudnative data lakes and data warehouse architectures on AWS Deep understanding of batch and streaming data pipelines Experience building scalable, faulttolerant data ingestion and transformation workflows SQL & Python (Mandatory) Strong SQL expertise Writing complex ...

... work independently and collaboratively to solve complex data challenges and drive continuous improvements across our data engineering practices. 4+ years of data engineering experience, building and managing large-scale data pipelines - Strong proficiency in Python, PySpark, Spark, Databricks, Delta Lake, PowerBI and SQL, ...

... in Python and SQL - Experience with Unity Catalog, cluster administration, and at least one major cloud platform (Azure, AWS, or GCP) - Solid understanding of data warehousing and dimensional modeling Databricks Certified Data Engineer (Associate or Professional) Cloud data engineering certification have minimum 5 years ...

... sentiment analysis, inventory optimization, promotion uplift modeling, campaign analysis, churn prediction etc. - Proficiency in programming languages such as Python or R, and experience with data manipulation libraries (e.g., Expertise in machine learning frameworks (e.g., TensorFlow, PyTorch, Scikit-learn) and statistical ...

... Data Migration. Proven expertise with Guidewire Data Migration Framework, Mammoth ETL, and related Guidewire tools. Strong knowledge of Guidewire PolicyCenter data model and its integration with external legacy systems. Proficiency in SQL, PL/SQL, and data transformation scripting (Python, Java, or Groovy preferred). Hands-on ...

... least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse ...

We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...

• Remote
• Hybrid
• On-site

1400 / year

... inquiries related to Addepar's portfolio data feeds and on general data product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage ...

... and business outcomes. - Develop scalable dashboards and reporting solutions to track pricing performance and enable self-serve analytics for commercial teams. Data Science & Decision Support - Utilize advanced data analysis, SQL, and Python to build predictive pricing models, opportunity sizing frameworks, and optimization ...