769 Open source projects that are alternatives of or similar to Gisaid Scrapper

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

Social media research and promotion, semi-autonomous CLI bot

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

Zillow Scraper for Python using Selenium

Automated Tinder bot and scraper using selenium in python.

Download public videos on TikTok using Python with Selenium

An Instagram Scrapper

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

Scraping Visually Similar Images from Pinterest

A tutorial-based introduction to web scraping with Python.

Instagram comment scraper using python and selenium. Save the comments into excel.

No description or website provided.

A course downloader/scrapper for https://www.pluralsight.com

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

An Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

No description or website provided.

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

📷 Instagram private API in Java

[Unmaintained] A simple and clean video/music/image downloader 👾

INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。

Powerfull XSS Scanning and Parameter analysis tool&gem

Automated Script to scrape flight prices from any website into a csv format

A high performance web crawler in Elixir.

Distributed crawler powered by Headless Chrome

✂️ High performance, multi-threaded image scraper

IMDbPY is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

A news scraper for nodejs that help to scrap news from Indonesian news portal.

Python入门网络爬虫之精华版

🦊 Node.js API to control Firefox

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

A python web scraper for public email lists.

Scrapy middleware to handle javascript pages using selenium

FluentLenium is a website & mobile automation framework which extends Selenium to write reliable and resilient UI functional tests. This framework is React ready. Written and maintained by people who are automating browser-based tests on a daily basis.

Carina automation framework: Web, Mobile, API, DB

Fast, flexible, and lean implementation of core jQuery designed specifically for the server.

📈 Create GIFs from user's GitHub activity graph

A Telegram Mass Surveillance Bot in Python

滑动验证码破解示例，仅供学习使用。

A Facebook crawler

Scrape all the media from an OnlyFans account - Updated regularly

Scrapes an instagram user's photos and videos

Docker images for the Selenium Grid Server

Proxy-Scraper is simple Perl script for scraping proxies from multiple websites.

Download .torrent files from YTS YIFY

boilerplate for nightwatch.js with selenium

🤖 📷 Instagram Bot made with love and nodejs

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

Google does not provide Google Dictionary API so I created one.

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Scrapes Reddit to download media of your choice.

operative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.

Fetch new releases from http://www.juno.co.uk/.

Declarative DOM extraction expression evaluator. 👨‍⚕️

Unofficial API for finviz.com

A collection of awesome web crawler,spider in different languages

Get Instagram posts/profile/hashtag data without using Instagram API