134 Open source projects that are alternatives of or similar to Docbao

PHP Scraper - an highly opinionated web-interface for PHP

Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go

PHP Library for detecting CMS

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

Web Scraping Framework

Content based movie recommendation system with sentiment analysis

Receive an email or Telegram message as soon as Migros Sanalmarket is available for delivery in your neighborhood.

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Zillow Scraper for Python using Selenium

Audio Book scrapper

Go cascadia package command line CSS selector

🚆This web scraper builds a dataset for São Paulo subway operation status

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

Web application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).

Fetch user's data across social media

Simple search for organisations participating/participated in the GSoC

Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Scape top GitHub repositories and users based on keywords

This repository provides everything you need to get started with Python for (social science) research.

No description or website provided.

Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

Scraping Ebay's products using Scrapy Web Crawling Framework

⚡️ Ayakashi.io - The next generation web scraping framework

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Snoop — инструмент разведки на основе открытых данных (OSINT world)

Simple scripts that I'm using to automate the boring things.

Selenium-python but lighter: Helium is the best Python library for web automation.

Compensation analysis on the posts scraped from leetcode.com/discuss/compensation. At present, the reports have been generated only for Indian cities.

Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username

𝐫⟋ Get Reddit data

Android app for saving webpages for offline reading.

A Dragnet that also extract author, headline, date, keywords from context

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

web scraping tool for grailed.com

Nextjs server to query websites with GraphQL

Searching torrents on popular trackers - CLI, readline, GUI, web client. Tutorial and binaries (issue tracker on https://gitlab.com/vindarel/cl-torrents/)

A Devtools driver for web automation and scraping

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Random User-Agent middleware based on fake-useragent

covers python basic to advance topics, practice questions, logical problems in python, web development using html, css, bootstrap, jquery, DOM, Django 🚀🚀. 💥 🌈

Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)

🕸→ℹ️ Reap Information from Websites

UI.Vision: Open-Source RPA Software (formerly Kantu) - Modern Robotic Process Automation with Selenium IDE++

Bulk Downloader for Reddit

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

You can use this act to monitor any page's content and get a notification when content changes.

List of libraries, tools and APIs for web scraping and data processing.

🌎 🏨 Scrape Booking.com 🏨 🌎

A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Scrape, standardize and share public meetings from local government websites

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

Scrapy crawler to collect data on the back catalog of songs listed for sale.

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn