Senior Python Data Scraping Engineer (Freelance) in… - Jobeax
Vacancy description
Senior Python Data Scraping Engineer (Freelance) in Kolkata, India
Mindrift
RemoteWork from anywhere
Part-timeFewer hours each week
ContractFixed-term or freelance
$30 USD / hour
India, Kolkata
Senior Python Data Scraping Engineer (Freelance) in Kolkata, India is listed on Jobeax. Browse 30,000+ vacancies available.
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer , you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $30 per hour equivalent , depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
Job Title: Senior Data Engineer Eperience - 10+ to 18 yrs Location: Remote Type: Contract( Comfortable with a 6-month contractual role) Requires strong hands-E xperience in AI and Data Engineering with strong expertise in Azure OpenAI, Azure AI Foundry, Agentic AI, RAG, LLMs, AutoGen, OCR, Databricks, PySpark, Python, Azure ...
... checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience - Proven production data engineering experience at scale - Strong Python and SQL skills - Deep analytical warehouse ...
... Computer Science, Information Technology, Engineering, or related field. - 8+ years of experience in Devops and 3+ years in DBX. - Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow). - Proficiency in SQL and programming languages like Python or Scala. - Experience with Azure cloud data services. ...
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
... best practices. Monitor and troubleshoot data pipelines for continuous reliability and efficiency improvements . Why Join KANINI? Join KANINI’s award-winning Data Engineering Team, recognized as the "Outstanding Data Engineering Team" at DES 2025 Work on real-world problemsat the intersection of data, AI, and product development ...
... high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts. About the Role This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer , you'll handle data scraping tasks requiring technical precision for web extraction and ...
... high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts. About the Role This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer , you'll handle data scraping tasks requiring technical precision for web extraction and ...
... Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand data issues and Conduct root cause analysis. Prepare Ageing report on the pending issues and follow up to closure Key Skill SQL / Python / Java / Data Governance Drive ...
Senior Full Stack Engineer – Python, Django, React, AI Location: Ahmedabad, Gujarat (Onsite only) Employment Type: Full-Time Experience: 3+ Years Domain: Finance | Microservices | AI-Driven Development About the Role: We are looking for a skilled and driven Full Stack Engineer to join our engineering team. In this role, ...
Role: Senior Backend Engineer - Python/Django Function: Engineering Type: Full-time Industry: AI, Medical SaaS A dental practice management SaaS platform serving thousands of practices across North America. Founded by a practicing dentist who experienced operational challenges firsthand. The team automates busywork like ...
... and continuous improvement. Analyze and optimize system interactions within the Linux environment, ensuring efficient resource utilization. Address large-scale data engineering challenges, implementing solutions for efficient data processing and transformation. Drive engineering best practices, including robust testing, clean ...
... similar platforms. Collaborate with researchers and engineers on data-driven solutions. Maintain clear documentation for all code. Job Requirements: - 3+ years of Python development experience. - Bachelor's/Master's in Computer Science, Engineering, or related field. - Strong Python skills with experience in Pandas, NumPy, SciPy, ...
... https://jobeax.com/link/2luqtWY4b55DMQvB Skills and Qualifications :- Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.- Advanced proficiency in Python for data processing, automation, and integration.- Deep understanding of relational and NoSQL databases, including ...
... to engage with non-technical business leaders to understand their data needs and translate them into accurate, visual reports. Desired Skills (Bonus Points) Tableau Certification (e.g., Tableau CertifiedData Analyst, Desktop Specialist). Experience with Python or R for advanced statistical analysis feeding into Tableau
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
... understanding of SQL and relational databases - Basic understanding of statistics and data analysis techniques - Familiarity with Power BI, Tableau, or similar data visualization tools - Basic knowledge of data cleaning and data preparation - Familiarity with Python and libraries such as Pandas or NumPy is a plus - Understanding ...
... based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, ...
... capture the most granular data. Align the engineering and product teams on the Data Granularity and accuracy requirements. Build Alerts to detect bugs in the data pipeline. Perform data analysis to test hypothesis and uncover factor influencing metric variations Build Feature Store for Data Science implementations Overall ...
... Machine Learning models and their https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, ...
... optimize Python-based data science solutions using public datasets. Create well-documented Python code using Jupyter notebooks. Bachelor's/Master's degree in Engineering, Computer Science, or equivalent experience. Knowledge of Python programming for data analysis. Strong understanding of data science methodologies and analysis ...