All Projects → imthaghost → Goclone

imthaghost / Goclone

Licence: mit
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Labels

Projects that are alternatives of or similar to Goclone

Docs
《数据采集从入门到放弃》源码。内容简介:爬虫介绍、就业情况、爬虫工程师面试题 ;HTTP协议介绍; Requests使用 ;解析器Xpath介绍; MongoDB与MySQL; 多线程爬虫; Scrapy介绍 ;Scrapy-redis介绍; 使用docker部署; 使用nomad管理docker集群; 使用EFK查询docker日志
Stars: ✭ 118 (-11.94%)
Mutual labels:  crawler
Crawlab Lite
Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (-8.96%)
Mutual labels:  crawler
Weibo Topic Spider
微博超级话题爬虫,微博词频统计+情感分析+简单分类,新增肺炎超话爬取数据
Stars: ✭ 128 (-4.48%)
Mutual labels:  crawler
Free proxy website
获取免费socks/https/http代理的网站集合
Stars: ✭ 119 (-11.19%)
Mutual labels:  crawler
Qqmusicspider
基于Scrapy的QQ音乐爬虫(QQ Music Spider),爬取歌曲信息、歌词、精彩评论等,并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料
Stars: ✭ 120 (-10.45%)
Mutual labels:  crawler
Fontobfuscator
字体混淆服务
Stars: ✭ 125 (-6.72%)
Mutual labels:  crawler
Decryptlogin
APIs for loginning some websites by using requests.
Stars: ✭ 1,861 (+1288.81%)
Mutual labels:  crawler
Red hawk
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
Stars: ✭ 1,898 (+1316.42%)
Mutual labels:  crawler
Skill Share Crawler Dl
Download Videos Skill Share per ID or per Class
Stars: ✭ 122 (-8.96%)
Mutual labels:  crawler
Kuaishou Crawler
As you can see, a kuaishou crawler
Stars: ✭ 126 (-5.97%)
Mutual labels:  crawler
Php Crawler
A php crawler that finds emails on the internets
Stars: ✭ 119 (-11.19%)
Mutual labels:  crawler
Pspider
简单易用的Python爬虫框架,QQ交流群:597510560
Stars: ✭ 1,611 (+1102.24%)
Mutual labels:  crawler
Squidwarc
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
Stars: ✭ 125 (-6.72%)
Mutual labels:  crawler
Sentinel Crawler
Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器,分布式爬虫
Stars: ✭ 118 (-11.94%)
Mutual labels:  crawler
Digger
Digger is a powerful and flexible web crawler implemented by pure golang
Stars: ✭ 130 (-2.99%)
Mutual labels:  crawler
Moodle Downloader 2
A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)
Stars: ✭ 118 (-11.94%)
Mutual labels:  crawler
Black Widow
GUI based offensive penetration testing tool (Open Source)
Stars: ✭ 124 (-7.46%)
Mutual labels:  crawler
Newspaper
News, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+8515.67%)
Mutual labels:  crawler
Mm131
MM131网站图片爬取 🚨
Stars: ✭ 129 (-3.73%)
Mutual labels:  crawler
Sina Weibo Album Downloader
Multithreading download all HD photos / pictures from someone's Sina Weibo album.
Stars: ✭ 125 (-6.72%)
Mutual labels:  crawler

jedi

Copy websites to your computer! Goclone is a utility that allows you to download a website from the Internet to a local directory. Get html, css, js, images, and other files from the server to your computer. Goclone arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link as if you were viewing it online.


Official Website



Example

Table of Contents

🚀 Installation

Brew

# tap
brew tap imthaghost/goclone
# install tool
brew install goclone

Manual

# go get :)
go get github.com/imthaghost/goclone
# change to project directory using your GOPATH
cd $GOPATH/src/github.com/imthaghost/goclone/cmd/goclone
# build and install application
go install

Todo

Visit the Notion link here to view Goclone's feature/bug progress.

Notion

Examples

# goclone <url> 
goclone https://dribbble.com

Dribbble

📝 License

By contributing, you agree that your contributions will be licensed under its MIT License.

In short, when you submit code changes, your submissions are understood to be under the same MIT License that covers the project. Feel free to contact the maintainers if that's a concern.

Contributors

Contributions are welcome! Please see Contributing Guide for more details.

Gary Frederick
Tha Ghost

💻
Ben Lafferty
Ben Lafferty

💻
Omar Sagoo
Omar Sagoo

💻
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].