Loading description…

Senior Python Data Scraping Engineer (Freelance) in… - Jobeax

Senior Python Data Scraping Engineer (Freelance) in Mumbai, India is listed on Jobeax. Browse 30,000+ vacancies available.

Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.

What We Do

The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.

About the Role

This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer , you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.

Key Responsibilities

Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.

Educational qualifications

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.

Academic and/or Professional Experience

Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.

Technical Skills (Essential)

Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)

Additional requirements

Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)

Project time expectations

For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.

Compensation

On this project, contributors can earn up to $30 per hour equivalent , depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.

Apply to vacancy

Similar vacancies

More like this role

Weekday AI

Data analyst - sql python

3 days ago

Full-time

... communication and stakeholder-management skills with the ability to explain complex data insights clearly. - Tableau certification such as Tableau Certified Data Analyst or Tableau Desktop Specialist will be an advantage. - Experience with Python or R for statistical analysis, data processing, or integrating analytical ...

India, Bengaluru

Axtria - Ingenious Insights

Axtria - Data Scientist - Python

3 days ago

... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...

India, Noida

letzbizz

Python Developer - Urgent

3 days ago

Full-time

... Proficient in Python and its frameworks (e.g., Django, Flask, FastAPI). - Experience with RESTful APIs and microservices architecture. - Strong knowledge of database systems like PostgreSQL, MySQL, or MongoDB. - Familiarity with data analysis libraries like Pandas, NumPy, and SciPy. - Experience with web scraping tools ...

India, Chennai

ganit inc.

Senior Data Engineer - AWS

Today

On-site

... governance. Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other ...

India, Bengaluru

Valuelabs

Senior Data Engineer - AWS

Today

We are seeking a Senior Data Engineer with 5+ years of experience in designing and building scalable data platforms, ETL pipelines, and data warehousing solutions. The ideal candidate will have strong expertise in distributed data processing, cloud technologies, and software engineering best practices. Key Responsibilities: ...

India, Rāniganj

KPI PARTNERS INDIA PRIVATE LIMITED

Senior Data Engineer - Fabric

2 days ago

... advanced data engineering and analytics, fostering a culture of collaboration and continuous https://jobeax.com/link/yeka7e9uOhXV2ngJ the Role :We are seeking a Senior Fabric Data Engineer who can help with the design and building of data https://jobeax.com/link/jcqkTDCTdscBt8W9 :- Building Data Factory pipelines in Fabric- ...

India, Bengaluru

Azilen Technologies

Senior Data Engineer - SQL

3 days ago

Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data ...

India, Ahmedabad

HumanWiz

Senior AI/ML Engineer - LLM/Python

Today

Contract

... development cycles following Agile practices and drive automation across the AI delivery https://jobeax.com/link/X6UuBSMsZJZJBlJC Candidate : - 1. Strong Senior AI Engineer Profile with production-grade LLM and Python expertise.- 2. Mandatory (Experience 1) : Must have at least 3+ years of professional AI/ML engineering experience ...

India, Indore

Intraedge Technologies Ltd.

Senior AI/ML Engineer - Python Frameworks

Today

Role : AI/ML Engineering / Full Stack DevelopmentJob Overview :We are looking for a Sr. AI/ML Engineer with 6+ years of experience in software engineering and AI/ML application development. The ideal candidate should have strong hands-on experience in Python, Django, FastAPI, Microservices, containerized applications, and ...

India, Hyderabad

Terralogic Software Solutions Private Limited.

Senior Quality Assurance Engineer - Python Automation

1 day ago

Role : Senior QA Engineer - Python Automation | Nutanix / VirtualizationCompany : TerralogicTotal Experience : 4 - 7 YearsJob Description : Terralogic is looking for a Senior QA Engineer with strong experience in Python automation, infrastructure testing, x86 hardware, virtualization, and Linux systems. The ideal candidate ...

India, Bengaluru

Laksh Consultants

Senior AI/ML Engineer - LLM/Python

5 days ago

Position : Senior AI/ML Engineer (LLM, Python)Overall Experience : 3 - 7 yearsLocation : Hyderabad/Indore/AhmedabadWorking Days : 5 Days from OfficeNotice Period : Immediate Joiners/Serving Notice PeriodRoles & Responsibilities : - Lead end-to-end design and delivery of production-grade AI/ML solutions including RAG pipelines, ...

India, Hyderabad

Laksh Consultants

Senior AI/ML Engineer - LLM/Python

6 days ago

India, Ahmedabad

3SHOOL TECHNOLOGY CONSULTANTS

Senior Data Operations Engineer - Data Pipeline Support

Today

... in:- Data Operations- Production Data Engineering- Data Platform Support- Data Pipeline Monitoring & Troubleshooting- Not looking for purely development-focused Data Engineers or DevOps/SRE https://jobeax.com/link/V6ZwWogXLIs5s3d8 Stack:Snowflake, dbt, Apache Airflow, Fivetran, Cloud Storage, SQL, Python, Bash, CI/CD, Git, ...

India, Pune

3SHOOL TECHNOLOGY CONSULTANTS

Senior Data Operations Engineer - Data Pipeline Support

1 day ago

India, Mumbai

Shell

Data Scientist (Python, ML, SQL)

Today

Hybrid

... systems (e.g., SAP, Salesforce, ServiceNow) into structured, analysis-ready pipelines for process-mining and machine-learning applications. Collaborate with senior data scientists, data engineers, and software developers to embed models into Shell's process-mining platform for scalable, real-time analytics. Develop algorithms ...

India, Chennai

Varaha

Data Scientist Ml Ai Python

Today

Remote

... sustainability sectors. Position: Senior Android Developer Develop and deploy satellite-based crop classification models using multispectral, hyperspectral, and SAR datasets (Sentinel-1/2, Landsat, NISAR). - Design Earth Engine Python API workflows for cropland segmentation, sowing date estimation, acreage mapping, and in-season ...

India, Bengaluru

neurealm

Data Scientist Ml Ai Python

1 day ago

... applications for accuracy, latency, and cost. Implement data preprocessing, feature engineering, and ML model training workflows. Work with structured and unstructured datasets to solve business problems. Collaborate with Product Managers, Software Engineers, and Subject Matter Experts to deliver AI-driven features. Monitor model ...

India, Gurugram

BDO India

Data Scientist (Python, ML, SQL)

1 day ago

Full-time

... hands-on professional experience Education: BE/B.Tech/ME/M.Tech/MCA/MSc IT Primary Skills (must have): Strong Azure or AWS knowledge Strong working knowledge on Data Science, Artificial Intelligence, Machine Learning Secondary Skills (good to have): SQL, Python Professional Attributes: Strong analytical and problem-solving ...

India, Mumbai

IMI

Data Scientist (Python, ML, SQL)

1 day ago

... opportunities, and business insights. Create dashboards, visualizations, and reports that communicate insights effectively to technical and non-technical stakeholders. Data Engineering & Solution Delivery Collaborate with data engineering teams to establish scalable data pipelines and AI-ready data platforms. Ensure data quality, ...

India, Bengaluru

AngelONE

Data Scientist (Python, ML, SQL)

1 day ago

... ad-hoc analysis and present results in a clear manner Work on the full lifecycle of machine learning development including sourcing, dataset curation, feature engineering, model training, model tuning, and offline & online experimentation Strong programming skills with minimum 3-6 years of experience in Python Experience working ...

India, Bengaluru