2435 Open source projects that are alternatives of or similar to Goscraper

Capture website thumbnails using the urlbox.io screenshot as a service API in node

It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.

This repository contains all the code I use in my YouTube tutorials.

Az összes számlád még egy helyen :)

Page metadata as a service

High performance crawler for Nodejs

The KIImagePager is inspired by foursquare's ImageSlideshow, the user may scroll through images loaded from the Web

Free 2D symbols for computer network diagrams

🖼 A simple file-upload utility that shows a preview of the uploaded image. Written in pure JavaScript. No dependencies. Works well with Bootstrap 4 or without a framework.

Crawly, a high-level web crawling & scraping framework for Elixir.

HTTP API for Scrapy spiders

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Be nice on the web

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

An R web crawler and scraper

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

No description or website provided.

A collection of awesome web crawler,spider in different languages

A Facebook crawler

A Vue Integrated PhotoSwipe Image Preview Plugin

一个基于 React 的可缩放图片控件 | A scalable image wrapper power by react

A high performance web crawler in Elixir.

Simple, Fast, Secure, Flat-File CMS

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

👾 Fast and simple video download library and CLI tool written in Go

crawler framework, distributed crawler extractor

A simple CMS for landing pages

Universal scrapping tool, which allows you to extract data using multiple environments

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Easily download the main content of a web page in html, markdown, and/or epub format from command line.

EXPLORE & EDIT REALITY

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

我的爬虫合集

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

Simple Weibo Scraper

快速、简洁且强大的PHP爬虫框架

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

OSINT Swiss Army Knife

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

⚡️ 可编程渲染管线实现，帮助初学者学习渲染

Declarative web scraping

Distributed crawler powered by Headless Chrome

Crawler for Nintendo Switch eShop

🤡SakuraKit, a lightweight and powerful library for application to switching themes or skins.

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

[Unmaintained] A simple and clean video/music/image downloader 👾

LinkedIn Scraper (currently working 2020)

Distributed Image Search Engine Crawler

Mobile-friendly picture file input Vue.js component with image preview, drag and drop, EXIF orientation, and more

Clean and simple gem downloads count badge, courtesy of http://shields.io/. You can checkout the application directly at the following URL:

Scraping scripts for various websites.

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

Elegant Scraper and Crawler Framework for Golang

Crawl BookCorpus

Vue plugin for image preview base on PhotoSwipe