2,501 big data python jobs in India.

$100 USD

... build, and optimize high-throughput data pipelines using Python, R, and PostgreSQL to handle market and execution data. - Build and manage robust, scheduled data workflows using tools like Airflow/Dagster to ensure 24/7 data availability for global markets. - Monitor pipeline health, debug data discrepancies in logs, and ...

• Hybrid
• Full-time

... NLP/ASR, or document intelligence - Proven ability to present complex model outputs to non-technical audiences credit committees, CXOs, regulators - Strong Python and SQL ; fluency with cloud-based data pipelines and experiment tracking - Experience with low-resource or multilingual models Prior experience in an early-stage ...

... experience in the Big Data Ecosystem. Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop echo systems. Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle ...

... frameworks for data integration and ETL processes, such as Apache Kafka, Apache Spark, Apache Airflow, or Talend. - Data Modeling and Database Design: Knowledge of data modeling concepts, dimensional modeling, and schema design to create efficient and scalable database structures. - Big Data Technologies: Experience with big ...

• Hybrid
• On-site

17k

It has been more than 60 years since SYSTRA has garnered expertise that spans the entire spectrum of Mass Rapid Transit System. SYSTRA India’s valuable presence in India roots back to 1957, where SYSTRA worked on the electrification of Indian Railways.

20500

... fabrication, material research, or computational geometry. Familiarity with collaborative workflows, data visualization, and interoperability between design software. Understanding of cloud-based computing or scripting for large-scale data processing for design applications. Revit & BIM - mandatory C#/Python - preferred

• Full-time

... Science, Data Engineering, or related field. Experience: 4–6 years in data engineering with expertise in: Programming: Python, Scala, or Java (Python preferred) Big Data & Processing: Apache Spark, Kafka, Hadoop Databases: SQL and NoSQL (Postgres, MongoDB, Cassandra) Data Warehousing: Snowflake, Redshift, BigQuery, or similar ...

... dashboard migration and embedded analytics. Knowledge exposure to Other BI tools: Experience with other BI tools such Tableau or Qlik Sense will be added advantage. Data Engineering Collaboration : Collaborate with Data Engineers to align with data pipelines, validate source-to-report logic, and ensure data accuracy across layers ...

... version control (Git) and CI/CD practices - Understanding of agile delivery methodologies. Must Have Skills: Databricks Power BI / DAX Dimensional modelling Python Azure services (storage, compute) Nice to have Skills: Experience with dbt or other modern data stack tools Knowledge of data governance and cataloguing (Unity ...

... hands-on experience in data science.- Strong proficiency in Python and libraries such as NumPy, pandas, scikit-learn, TensorFlow/PyTorch.- Expertise in SQL for data extraction, transformation, and analysis.- Proven experience with PySpark or distributed data processing frameworks.- Deep understanding of machine learning and ...

• Remote
• Part-time
• Contract

$30 USD / hour

... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...

• Remote
• Part-time
• Contract

$30 USD / hour

... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...

... stack development with strong expertise in Python (backend) and https://jobeax.com/link/6WcBICn0LM558SP0 (frontend) . - Hands-on experience in Data Engineering, Data Warehousing, and processing large-scale datasets (e.g., BigQuery, Snowflake). - Strong understanding of ETL/ELT pipelines, data modeling, and data architecture ...

... An ideal candidate will be someone with sound technical background in working with SQL, Scripting (Python, typescript, javascript), databases, ML/LLM models, big data technologies such as Apache Spark (Pyspark, Spark SQL). Build end to end data extraction, data transformation and data pipelines to ensure data availability ...

• Hybrid

... ability to design and fine-tune Deep Learning architectures and NLP models to solve real-world language processing challenges.- Strong proficiency in SQL and Big Data technologies, with the ability to manage and query large-scale databases to support data-intensive applications.- Exceptional communication skills, with ...

Requirements Strong programming skills in Python and SQL. Experience with data processing leveraging programming skills in Python and Spark. In-depth understanding of the Kafka platform for (real-time) data ingestion and processing of high-volume data. Design and architect data flows and data management in a Cloud environment ...

... anomalies. Required Qualifications • 5+ years in QA or software testing, including focused on data pipelines/data warehouses • Proficient in complex SQL and writing data validation queries. • Strong experience with GCP data tools: dbt, BigQuery, Dataflow, Dataproc, Cloud Run, Spanner, AlloyDB, Cloud SQL. • Hands-on with data-quality ...

... transformation, and loading of data from a wide variety of data sources using Pyspark, SQL and AWS big data-technologies - Build analytics tools that use the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics - Manipulate data at scale: ...

• Full-time

Full time For contractors For subcontractor Local area Weekend work

• Remote
• Full-time

... Practical experience working with real-world datasets. Experience in data cleaning, preprocessing, and exploratory data analysis. Hands-on exposure to SQL, Excel, Python, and data analytics tools. Experience creating dashboards, visualizations, and analytical reports. Practical understanding of data-driven decision-making. Experience ...