206 Open source projects that are alternatives of or similar to Soup

🌎 🏨 Scrape Booking.com 🏨 🌎

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

A framework for creating semi-automatic web content extractors

A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar

State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.

A program which takes an Anime name or URL and downloads the specified range of episodes.

Pawn package manager for SA-MP

Scraping articles of medium and providing audio versions 📑 to 🔊 using django

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

📚 A GoodReads.com Scraper script to get books reviews including text and rating.

Helpful Selenium functions to make web-scraping easier and faster

단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!

Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.

Scrape your favorite Anime from Okanime.com without effort

A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.

Creating Scrapy scrapers via the Django admin interface

This repository contains data and code used to get and clean data from https://github.com/CSSEGISandData/COVID-19 and https://www.worldometers.info/coronavirus/

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

Create agents that monitor and act on your behalf. Your agents are standing by!

Various python scripts, mostly geared towards dataviz.

A list of practical knowledge-building projects.

R语言爬虫；Python爬虫；rvest；Rcurl

A python web scraper for public email lists.

Powerful web scraping framework for Crystal

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Simple but useful Python web scraping tutorial code.

A Fast Broken Link Hijacker Tool written in Python

可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

lots of spider (很多爬虫）

Archive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushshift API.

PHP Library for detecting CMS

An exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Go cascadia package command line CSS selector

A collection of awesome web crawler,spider in different languages

Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube

Simple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.

📊Python script to analyze the contents of your Facebook data export

🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy

Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

Faster requests on Python 3

🎶 Unofficial python API for pitchfork.com reviews.

🥫 The simple, fast, and modern web scraping library

Scrape GSoC organisations using a single script.

A supreme web bot, written in python, to grab a list of specified products, and checkout before they sell out!

Suck the InTernet

Take the hassle out of web scraping

Perceptual image hashing for Node.js

Fetch user's data across social media

Bulk download your favourite anime episodes from your favourite anime websites

A Python library for automating interaction with websites.

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

A list of scrapers from around the web.

a class that uses scraped proxies to make http GET/POST requests (Python requests)

Code for the second edition Web Scraping with Python book by Packt Publications

A modern CSS selector implementation for BeautifulSoup

Nunux Keeper core API

Download and generate e-books from online sources.

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.