2,502 big data python jobs in India.

• Contract

... and improve data quality. Monitor pipeline reliability, data availability and performance. What we're looking for - 5+ years of experience in Data Engineering, Data Operations or a related field. - Strong experience with GCP and Azure data platforms. - Hands-on experience in data pipelines, ETL, databases and data warehousing. ...

Senior Tech Specialist, Applications & Platforms

• Remote

... Requirements - 8+ years of relevant professional experience, supported by a bachelor's degree or equivalent practical experience. - Strong experience working with large datasets using Python and SQL; experience with Go is an advantage. - Solid knowledge of statistics, probability, data analysis, machine learning, and clustering techniques. ...

... data from multiple enterprise systems. • Understand and document finance-related business logic and technical data flows. • Support integration of SAP financial data into reporting and planning solutions. • Collaborate with global stakeholders to gather and clarify business requirements. • Support data modelling and data transformation ...

... similar field, or relevant professional experience in lieu of a degree - 5+ years of hands-on industry data engineering experience - Proficiency in SQL, Spark, Python - Hands-on experience with Databricks, AWS, Snowflake - Demonstrated strength in data modeling, ETL development, and data streaming. - Experience with AWS products ...

• Full-time

... architects to deliver enterprise-grade data solutions. Databricks Python PySpark SQL Medallion Architecture (Bronze / Silver / Gold) 4–6 years of production Data Engineering experience. Deep understanding of ETL/ELT design patterns and large-scale data processing. Cloud: Microsoft Azure (ADF, ADLS, Synapse) GCP (BigQuery, ...

• Hybrid

... Strong proficiency in Java programming. Experience with Big Data technologies such as Hadoop and HDFS. Hands-on experience with Spark and Scala. Proficiency in Python programming. Solid understanding of SQL and relational database concepts. Experience working in a Cloud environment (AWS or GCP). Experience with Unix/Linux ...

... continuous learning, innovation, and https://jobeax.com/link/CJhpbCLNKgiwJXSF Qualifications :- 8 - 14 years of overall experience, with at least 3 - 5 years leading data science or analytics teams.- Strong understanding of machine learning, statistics, and data modeling.- Hands-on experience with Python, R, SQL, and modern ML ...

... maintain scalable data transformation pipelines using Python (with tools like PySpark, ADF...) and SQL in Azure Databricks.- Implement transformation logic to move data from Bronze to Silver/Gold layers following data engineering best practices.- Apply strong data engineering principles to ensure data reliability, quality, performance, ...

35k

... experience applying advanced statistical methods to large, complex datasets. Proficiency in PySpark, Python, R, and SQL is essential, along with familiarity in data visualization tools such as PowerBI, MicroStrategy, Tableau, QlikView, or D3.js. Experience working on platforms like Databricks and with IQVIA datasets is highly ...

... translate business goals into data science problem statements success metrics and experiment plans Build evaluate and deploy machine learning and AI models using Python ensuring performance robustness and scalability Perform end to end data science workflows data collection cleaning feature engineering model training validation ...

• Remote
• Part-time
• Contract

$20 USD / hour

... scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...

... Python, SQL, and ML libraries (Pandas, Scikit-learn, TensorFlow, PyTorch).- Proven expertise in deploying ML models into production systems.- Experience with big data platforms (Hadoop, Spark) and distributed data processing.- Hands-on experience with Databricks, Airflow, and AWS EMR.- Strong knowledge of AWS cloud services ...

• Remote
• Hybrid
• On-site

... monitoring. Drive project-management rigor — dependency management, risk escalation, and stakeholder reporting. Collaborate with data engineers and IT teams to ensure data availability, quality, and reliability for analysis and modelling. Expertise in programming languages such as Python or R for data manipulation, analysis, and ...

• Remote

... https://jobeax.com/link/oQeJiiR2TtjToaqi least 4 years of experience in Information Technology Good experience in programming languages such as Python/Java/Scala, SQL and experience with data visualization tools like Tableau or Power BI https://jobeax.com/link/D7jAhstFP8xZgdHX least 3 years of experience in Cloud platforms (e.g., ADF, Data bricks, ...

... Experience architecting and operationalizing ETL/ELT pipelines with Spark, PySpark, or SparkSQL at scale. Proficiency in SQL and at least one scripting language (Python preferred). Experience with data modeling, warehousing, and building batch and near-real-time pipelines. Experience with workflow orchestration tools (Airflow, ...

• Hybrid

15250

... Qualifications Educational qualifications & Experience: Bachelor's degree in computer science, Information Security, or related field. 10–12 years of experience in data loss prevention, data discovery/classification, and database/data security. Experience with DSPM tools and integration in hybrid environments. Familiarity with ...

Data & AI ArchitectLocation: Hyderabad / Bangalore / PuneKey Technologies:Databricks | Microsoft Fabric | GenAI | LLM | RAG | PySpark | Data Lake | Lakehouse | Data Warehouse | Data ModellingRole Overview :We are looking for an experienced Data & AI Architect to design and lead enterprise - scale Data and AI architectures. ...

... frameworks for NLP and LLM-based applications. Create and optimize data transformation workflows using Python, Apache Spark, and Spark SQL. Develop and manage Vector Database pipelines for embedding storage and retrieval. Implement text normalization, sentence segmentation, deduplication, and data quality processes. Design and ...

... optimization and performance tuning experience Data Engineering: Experience with data orchestration platforms (Airflow, Azure Data Factory, SSIS, or similar) Big Data: Familiarity with Apache Spark, PySpark, or similar distributed processing frameworks Cloud Platforms: Hands-on experience with Azure, AWS, or GCP data services ...