7 open source projects by NikolaiT

Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

Update of uncaptcha2 from 2019

Javascript scraping module based on puppeteer for many different search engines...

Passive TCP/IP Fingerprinting Tool. Run this on your server and find out what Operating Systems your clients are *really* using.

Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.

Cloud crawler functions for scrapeulous