Loading description…

Senior Python Data Scraping Engineer (Freelance) in… - Jobeax

Senior Python Data Scraping Engineer (Freelance) in Mumbai, India is listed on Jobeax. Browse 30,000+ vacancies available.

Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.

What We Do

The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.

About the Role

This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer , you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.

Key Responsibilities

Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.

Educational qualifications

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.

Academic and/or Professional Experience

Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.

Technical Skills (Essential)

Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)

Additional requirements

Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)

Project time expectations

For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.

Compensation

On this project, contributors can earn up to $30 per hour equivalent , depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.

Apply to vacancy

Similar vacancies

More like this role

zorba ai

Data analyst - sql python

13 days ago

... Software Engineering / Data Engineering Fundamentals Basic software design principals Unit testing Version control High performance code to work at sc Skillset: Data Analyst Exp: 5+ Yrs Location : PAN India SQL DDL and DML skills on structured and non-structured data base Python- Coding for data parsing, manipulation, aggregation ...

India, Delhi

Akamai Technologies

Senior Data Engineer (Marketing Data Engineering)

13 days ago

Senior Data Engineer II Join our Data Engineering, Analytics & Intelligence team The Data Engineering, Analytics & Intelligence team is the engine behind our data-driven culture. We partner across the enterprise—from Finance (Accounting, Customer Revenue Operations, Business Finance) to Sales and Marketing—to build the ...

India, Bengaluru

letzbizz

Python Developer - Urgent

1 day ago

Full-time

... Proficient in Python and its frameworks (e.g., Django, Flask, FastAPI). - Experience with RESTful APIs and microservices architecture. - Strong knowledge of database systems like PostgreSQL, MySQL, or MongoDB. - Familiarity with data analysis libraries like Pandas, NumPy, and SciPy. - Experience with web scraping tools ...

India, Chennai

KPI PARTNERS INDIA PRIVATE LIMITED

Senior Data Engineer - Fabric

Today

... advanced data engineering and analytics, fostering a culture of collaboration and continuous https://jobeax.com/link/yeka7e9uOhXV2ngJ the Role :We are seeking a Senior Fabric Data Engineer who can help with the design and building of data https://jobeax.com/link/jcqkTDCTdscBt8W9 :- Building Data Factory pipelines in Fabric- ...

India, Bengaluru

ganit inc.

Senior Data Engineer - AWS

Today

On-site

... governance. Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other ...

India, Bengaluru

Azilen Technologies

Senior Data Engineer - SQL

1 day ago

Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data ...

India, Ahmedabad

Equal Experts

Senior Data Engineer - SQL

13 days ago

Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted today Job Be an early applicant About the job Strong hands-on experience with Python, SQL, and PySpark. Strong understanding of unit testing, test automation, ...

India, Bengaluru

wpp media

Senior Data Engineer - Hybrid

13 days ago

Hybrid
On-site

... closely with teams across the United States, Europe, and Asia to deliver high-impact solutions in a collaborative, multicultural environment. We are looking for a Senior Data Engineer , based out of Gurgaon/Bangalore who will: Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data ...

India, Bengaluru

NovintiX

Senior Data Engineer - AWS

13 days ago

... experience in data engineering. - Proficiency in: Programming languages - Python, Java, SQL, Spark SQL. - Data technologies - Hadoop, PySpark, NoSQL databases. - Data visualization tools - Qliksense, Tableau, Power BI - Cloud platorms - Azure Data Factory, Azure Databricks, AWS NovintiX is a fast-growing engineering and digital ...

India, Coimbatore

Terralogic Software Solutions Private Limited.

Senior Quality Assurance Engineer - Python Automation

Today

Role : Senior QA Engineer - Python Automation | Nutanix / VirtualizationCompany : TerralogicTotal Experience : 4 - 7 YearsJob Description : Terralogic is looking for a Senior QA Engineer with strong experience in Python automation, infrastructure testing, x86 hardware, virtualization, and Linux systems. The ideal candidate ...

India, Bengaluru

Laksh Consultants

Senior AI/ML Engineer - LLM/Python

3 days ago

Position : Senior AI/ML Engineer (LLM, Python)Overall Experience : 3 - 7 yearsLocation : Hyderabad/Indore/AhmedabadWorking Days : 5 Days from OfficeNotice Period : Immediate Joiners/Serving Notice PeriodRoles & Responsibilities : - Lead end-to-end design and delivery of production-grade AI/ML solutions including RAG pipelines, ...

India, Hyderabad

Laksh Consultants

Senior AI/ML Engineer - LLM/Python

4 days ago

India, Ahmedabad

FundsIndia

Data Scientist (Python, ML, SQL)

Today

... Storytelling- translate technical findings into clear, actionable recommendations for non-technical stakeholders, including senior leadership. 3-4 years of experience in data science, analytics, or a related quantitative role, ideally handling large, real-world datasets. - Strong hands-on skills in Python and SQL, with solid fundamentals ...

India, Bengaluru

Team Geek Solutions

Data Scientist Ml Ai Python

Today

Hybrid

... scalable solutions Generate actionable insights through data analysis and modeling Deploy, monitor, and improve model performance Qualifications - Bachelor's/Master's in Computer Science, Data Science, Engineering, or related field - 3–8 years of relevant experience Skills: data scientist,genai,python,sql,pyspark,aiml,ml

India, Chennai

anko gcc

Data Scientist (Python, ML, SQL)

Today

... our team, choose your own path and work on projects that excite you. The Data and Analytics team drives competitive advantage by providing the best-in-class data, analytics, and insights for the Kmart Group. By using the latest cloud platforms tools, data engineering practices, and data science methods, the team is paving ...

India, Bengaluru

EMERGEnT

Data Scientist (Python, ML, SQL)

Today

$100 USD

... familiarity with topic-modeling and trace-clustering approaches (Clio-style summarize-then-embed pipelines, BERTopic, c-TF-IDF) is a strong plus - Proficient in Python and the standard data-science stack (pandas, scikit-learn, statsmodels, numpy) - Data engineering competence — you can design and ship ETL and data models (dbt ...

India, Bengaluru

DigitalCube Consultancy

Data Scientist (Python, ML, SQL)

Today

DATA SCIENTIST - TIME SERIES FORECASTINGAre you a Data Scientist who loves turning historical data into accurate predictions and actionable business insights?Were looking for a Data Scientist with strong hands-on experience in Time-Series Forecasting, Machine Learning, Python/R and SQL to build forecasting solutions that ...

India, Hyderabad

Appsierra Group

Data Scientist Ml Ai Python

Today

... in data science. Required qualifications : - Bachelor's or Master's degree in Data Science, Computer Science, or a related field. - 3-5 years of experience in data science or a related discipline. - Proficiency in generative AI and large language models. - Strong programming skills in languages such as Python or R. - Experience ...

India, Pune

Bahwan Cybertek

Business Data Analysts - SQL & Python

1 day ago

... translate stakeholder needs into clear, testable requirements and communicate effectively with technical teams. Strong SQL skills and experience working with large datasets. Familiarity with modern data environments and tooling (e.g., Databricks, ETL/ELT concepts, Azure, ADF, Python). Experience with governed data environments ...

India, Chennai

CommerceIQ

Data Scientist (Python, ML, SQL)

1 day ago

... Proficiency in Python, Pandas, NumPy, Scikit-learn, with experience using libraries such as XGBoost, LightGBM, CatBoost, and Statsmodels. Experience working with large datasets and data pipelines, including data preprocessing, data quality checks, transformation, aggregation, and feature generation using tools such as SQL, Spark/PySpark, ...

India, Bengaluru