Python Developer - Web Scraping & Automation in Jaipur, India is listed on Jobeax. Browse 30,000+ vacancies available.
Qualifications:- 5+ years of experience in Python development, with a strong focus on automation and data extraction.- Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests.- In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session/cookie management.- Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.- Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.- Solid understanding of web protocols ( cookies, headers), and ability to reverse-engineer network calls and authentication mechanisms.- Comfortable working with APIs, JSON/XML, and data https://jobeax.com/link/IJT4dnwEBUwwCtmp are looking for an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related https://jobeax.com/link/xBhc5ISc6eS3xGtn will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.Responsibilities:- Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.- Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session/token-based login flows.- Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.- Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.- Integrate and manage complex workflows across multiple portals, APIs, and data sources.- Contribute to architectural decisions, tooling, and best practices. (ref:hirist.tech)