Data Engineer - Web Scraping (3 months contract) in India, भारत
RemoteWork from anywhere
ContractFixed-term or freelance
India, भारत
We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 3 months contract. Who we are: Founded in 2006, CXG is a global customer experience company uniquely positioned at the intersection of data-driven retail performance, customer experience transformation, and operational execution across 200+ luxury brands worldwide. The mission of our 270 collaborators is to help brands transform customer and employee experiences through tailored insights, strategy, and implementation.
We are passionate about delivering impact.
Our clients include the world’s most admired luxury houses, and our solutions combine research, technology, and human expertise to elevate every customer interaction. What you will be doing:
Maintain and manage website scraping configurations using Python.
Monitor scraping configurations for errors and potential crashes.
Oversee retrieved data to detect potential issues and blockages.
Coordinate with stakeholders to understand scraping task requirements and report issues.
Prepare and share periodic reports on scraping activities with stakeholders.
Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
Requirements What you will bring along:
Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
Expertise in database technologies, both relational (SQL) and NoSQL.
Knowledge of cloud platforms, particularly Azure.
Solid understanding of data security measures and compliance standards.
Excellent Python experience for data engineering and automation.
Strong collaboration skills to work closely with data scientists and analysts.
Ability to optimize data pipelines for performance and efficiency.
Ability to build, test, and maintain tasks and projects.
Experience with version control systems, such as Git.
Hands-on experience with Airflow and/or DBT.
Experience with Terraform for infrastructure management.
... marketplaces. - Data Source Identification: Identify relevant websites and online sources from which data needs to be scraped. Collaborate with the team to understand data requirements and objectives. - Web Scraping Design: Develop and implement effective web scraping strategies to extract data from targeted websites. This includes ...
... marketplaces. - Data Source Identification: Identify relevant websites and online sources from which data needs to be scraped. Collaborate with the team to understand data requirements and objectives. - Web Scraping Design: Develop and implement effective web scraping strategies to extract data from targeted websites. This includes ...
... proxies, request headers, cookies, and browser fingerprinting libraries against anti-bot defenses. - Experience with CAPTCHA-solving approaches and reverse-engineering mobile or web APIs. - Solid understanding of HTML, DOM, browser developer tools, and modern data-loading techniques (XHR, fetch, dynamic rendering). - Experience ...
Senior Data Engineer (Engineer 3) Position Overview We are seeking an experienced Senior Data Engineer with 7+ years of professional experience. In this role, you will design, build, and maintain data infrastructure, pipelines, and platforms for collecting, storing, processing, and analyzing large volumes of data. You will ...
... interest in data research, web scraping, data management, and lead generation. This role involves collecting, verifying, organizing, and maintaining accurate data to support recruitment and business development activities. Key Responsibilities:- 1. Data Research & Web Scraping: Research and collect relevant information ...
... interest in data research, web scraping, data management, and lead generation. This role involves collecting, verifying, organizing, and maintaining accurate data to support recruitment and business development activities. Key Responsibilities:- 1. Data Research & Web Scraping: Research and collect relevant information ...
... Build the user-facing query interface (API + dashboard). Work with the founder to define the MVP, data sources, and monetization strategy. Ensure compliance with web scraping laws, GDPR, and data privacy regulations. What You Bring Strong experience in AI/ML engineering (NLP, information retrieval, knowledge graphs). Proficiency ...
... Build the user-facing query interface (API + dashboard). Work with the founder to define the MVP, data sources, and monetization strategy. Ensure compliance with web scraping laws, GDPR, and data privacy regulations. What You Bring Strong experience in AI/ML engineering (NLP, information retrieval, knowledge graphs). Proficiency ...
... structures, algorithms, software design, and database https://jobeax.com/link/mggjon8Tm8aeuyQo Skills : Springboot, ElasticSearch, MongoDB, MySQL, Redis, Crawling/ Web Scraping, Java, Python, C, C++Job Responsibilities : - Collaborate with Managers and other Engineers to help define, scope, and implement high-quality features ...
... in person, in interesting locations around the world, to align on strategy and execution. The company is founder-led, profitable and growing. We are hiring a Web/UI Engineer to develop a data-rich and reliable user experience. These frontends are constructed using JS, CSS, React, and Flutter, and serve as Canonical’s enterprise ...