Web Scraping R&D Developer
Join an experienced team responsible for R&D of a global travel booking engine. As a Web scraping R&D developer you will be responsible for research and implementing key components supporting search and booking processes used by millions of users around the world. Working on our systems you will gain experience with high scalability solutions, best practices according to Site Reliability Engineering recommendations from Google.
Client Details
This job offer is for people who have experience in Web Scraping. The technologies listed below are relevant, but not essential. Work based on browser architecture. The team is already established, with 4 people, nevertheless they need a strong person who will be independent and set the tone for the team.
Description
Challenges waiting for you:
- Research and explore effective methods of obtaining particular web content based on different, advanced technical solutions
- Designing and developing key system components using web scraping for our search and booking engine
- Developing and improving web scraping tools and frameworks used for our purposes
- Research and development, prototyping, testing web securing, optimizing web scraping processes
- Tool evaluation and selection
Tech Stack
- C++ >= v14
- JavaScript
- NodeJs >=v16
- .net6
- Puppeteer, Playwright and Webdriver
- Python
- Mongo
- Redis
- Rabbitmq
- k8s
- Google cloud
- Sql server
- Docker
- Kubernetes
Profile
Our expectations:
- The most important thing for us is openness to taking up challenges and the ability to combine knowledge from various areas of expertise. This job also requires consistency, patience and accuracy
- Good knowledge CDP, engine V8 and Blink
- Good understanding of web APIs used to build web applications. This includes HTML DOM, XMLHttpRequest, Fetch, Storage, Canvas, etc
- Good understanding of TCP/IP stack related technologies used for communication between client and server. This includes SSH, HTTPS, TLS/SSL, TCP, IP, etc.
- Experience in reverse engineering of web pages written with use of JavaScript
- Experience with automation tools like Puppeteer or Playwright
- If you have any web scraping experience it will be an extra bonus
Job Offer
What we offer:
- Attractive salary depending on your knowledge and experience 25000 to 32000 PLN net b2b
- Remote work on a daily basis for people from outside Katowice; with occasional visits to the headquarters (training, team integration, etc.)
- Full autonomy in creating solutions - self-organizing teams, freedom of work methodology and choice of technology
- Mature processes, Continuous Integration, daily deployments that allow you to immediately see the effects of your work
- Direct impact on solutions and close cooperation with business
- Advanced agile processes
- Great skill development opportunities - work with the latest technologies, internal and external trainings (e.g. with Machine Learning, Kubernetes)
- IT conferences - every year we are present at the most important industry conferences, not only in Poland, but also abroad (including Google Cloud Next, .NET Developer Days)
Location: Warszawa
Contract type: Na czas nieokreślony
About Michael Page
Michael Page is a leading professional recruitment consultancy specialising in the recruitment of permanent, contract and temporary positions on behalf of the world's top employers.
More
