2,468 big data python jobs in India.

... Python, DatabricksQualifications :- Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with ...

... features and data contracts. Build and ship models to: Enhance customer experiences and personalization Boost revenue via pricing/discount optimization Detect and block fraud/risk in real time Collaborate with Engineering to productionize via APIs/CI/CD/Docker on AWS. Build monitoring for model/data drift and business KPIs

... Python, DatabricksQualifications :- Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with ...

Rs 7.5 - 34.5 lakhs p.a.

Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...

... pipelines, transforming raw data into useful data systems, and optimizing the data delivery architecture. Responsible to design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, ...

• Remote
• Hybrid

27k

... interface performance during hypercare. Data From Process to Data Lake Data Validation & Process Improvement Support automation of CSV-Data upload by validation and data quality checks Perform data validation and cross-checks to ensure data quality and consistency Validate raw data and transform structured data to Data Model as ...

Lead Data Engineer

• Contract

675k

... contract and the Sponsor’s expectations. Core Responsibilities • Acts as Functional Lead for Data Management including primary contact for internal liaison between Data Management/Operations and Project Management, Clinical Monitoring, and other functional groups • Coordinate the work of the assigned Data Management/Data Operations ...

• Contract

... teams and engineering execution, ensuring data infrastructure directly drives revenue and AI/ML https://jobeax.com/link/q3usO6A8ieWThPkm Responsibilities :- Data Platform Ownership : Design and scale a multi-region data warehouse architecture (Snowflake/BigQuery/Redshift) and manage complex ingestion pipelines from marketplaces, ...

Rs 22 - 30 lakhs p.a.

... between reviews. Stack: Python, PostgreSQL, Django, server-rendered frontend (htmx). What You Will Own Core Responsibilities / Engineering Focus Deep third-party data ingestion Build reliable ingestion pipelines for external data sources Account for silently dropped webhooks through reconciliation with source-of-truth totals ...

• Hybrid

... for high-volume batch processing. Proficiency with ETL tooling such as SSIS, Azure Data Factory, or equivalent, along with scripting (PowerShell/Python) for data validation and automation. Good understanding of data quality, de-duplication, cleansing, and validation techniques. Working knowledge of cloud data platforms ...

• Full-time

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 ...

... data science, or related experience - Proficiency (2–4 years) in SQL, R, Python, Excel, etc., for effective data manipulation - Hands-on experience with Snowflake and Spark/Databricks, adept at Query Profiles and bottleneck identification - Apply creative thinking to solve real-world problems using data-driven insights

... and scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability ...

... and real-time data processing https://jobeax.com/link/NEGihx4n1Wqwy714 Skills : - Databricks : Notebooks (Python, SQL), SQL Editor, Unity Catalog, Delta Lake, Databricks Notification Alerts, Genie Spaces, and performance optimization.- Azure Data Factory (ADF) for ETL/ELT orchestration.- Advanced Python, PySpark, and SQL ...

... Shell Scripting. Strong analytical skills for data engineering tasks. Familiarity with tools likeApache Airflowfor data migration workflows. Experience with database systems such asOracle,MySQL, orDB2. Knowledge of legacy data migration from diverse sources. Previous experience with data migration to platforms like ServiceNow. ...

• Remote

... ~ Manage budgets related to data sourcing, annotation operations, and vendor contracts. 8+ years of overall experience in GIS, remote sensing, or geospatial data operations; Strong hands-on knowledge of satellite imagery sourcing (optical, SAR, multispectral) and remote sensing data pipelines. - Proven experience managing ...

• Hybrid
• On-site

700k

... success. Migrate and transform client corporate governance data and documents into Diligent platforms, ensuring accuracy, consistency, and completeness. Run regular data quality checks, validate data against source records, and quickly correct errors to maintain high data integrity. Use advanced Excel functions, databases, and ...

... well-documented code that others can understand and maintain All About You passionate about using data visualisations to tell stories 1–3 years experience in creating data visualisations proficient in R or Python proficient in using code to clean data, transform, and aggregate data familiar with version control concepts and tools ...

• Hybrid

... building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data.- Solid understanding of data warehousing concepts and data modelling techniques (e.g. dimensional modelling, slowly changing dimensions).- Hands-on experience with BigQuery, Airflow or Argo Workflows, Dataflow, and Pub/Sub ...