sczhengyabin / Image Downloader
Licence: mit
Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.
Stars: ✭ 1,173
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Image Downloader
Sitedorks
Search Google/Bing/Ecosia/DuckDuckGo/Yandex/Yahoo for a search term with a default set of websites, bug bounty programs or a custom collection.
Stars: ✭ 221 (-81.16%)
Mutual labels: bing, google, baidu
Xinahn Socket
一个开源,高隐私,自架自用的聚合搜索引擎。 https://xinahn.com
Stars: ✭ 77 (-93.44%)
Mutual labels: bing, google, baidu
Scrapy-SearchEngines
bing、google、baidu搜索引擎爬虫。python3.6 and scrapy
Stars: ✭ 28 (-97.61%)
Mutual labels: bing, scrapy, baidu
Jsearch
jSearch(聚搜) 是一款专注内容的chrome搜索扩展,一次搜索聚合多平台内容。
Stars: ✭ 193 (-83.55%)
Mutual labels: bing, google, baidu
Translators
🌏🌍🌎Translators🌎🌍🌏 is a library which aims to bring free, multiple, enjoyable translation to individuals and students in Python. Translators是一个旨在用Python为个人和学生带来免费、多样、愉快翻译的库。
Stars: ✭ 295 (-74.85%)
Mutual labels: bing, google, baidu
Search Deflector
A small program that forwards searches from Cortana to your preferred browser and search engine.
Stars: ✭ 620 (-47.14%)
Mutual labels: bing, google
Sou
简单搜索,一个简单的前端界面。用惯了各种导航首页,满屏幕尽是各种不厌其烦的广告和资讯;尝试自己写个自己的主页。
Stars: ✭ 628 (-46.46%)
Mutual labels: google, baidu
Alipayspider Scrapy
AlipaySpider on Scrapy(use chrome driver); 支付宝爬虫(基于Scrapy)
Stars: ✭ 70 (-94.03%)
Mutual labels: spider, scrapy
Mailinglistscraper
A python web scraper for public email lists.
Stars: ✭ 19 (-98.38%)
Mutual labels: spider, scrapy
Python Spider
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
Stars: ✭ 615 (-47.57%)
Mutual labels: spider, scrapy
Icrawler
A multi-thread crawler framework with many builtin image crawlers provided.
Stars: ✭ 629 (-46.38%)
Mutual labels: spider, scrapy
Funpyspidersearchengine
Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
Stars: ✭ 782 (-33.33%)
Mutual labels: spider, scrapy
Crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Stars: ✭ 8,392 (+615.43%)
Mutual labels: spider, scrapy
App comments spider
爬取百度贴吧、TapTap、appstore、微博官方博主上的游戏评论(基于redis_scrapy),过滤器采用了bloomfilter。
Stars: ✭ 38 (-96.76%)
Mutual labels: spider, scrapy
Django Dynamic Scraper
Creating Scrapy scrapers via the Django admin interface
Stars: ✭ 1,024 (-12.7%)
Mutual labels: spider, scrapy
Image Downloader
中文说明
1. Introdoction
Crawl and download images using Selenium Using python3 and PyQt5
2. Key features
- Supported Search Engine: Google, Bing, Baidu
- Keywords input from keyboard, or input from line seperated keywords list file for batch process.
- Download image using customizable number of threads.
- Fully supported conditional search (eg. filetype:, site:).
- Switch for Google safe mode.
- Proxy configuration (socks, http).
- CMD and GUI ways of using are provided.
3. Install
3.1 Download and install Python3.5+
- Download Latest version of Python3.5 installer from here
3.2 Download and setup chromedriver [recommend]
- Require Google Chrome Browser or Chromium Browser installed.
- Download the corresponding version of chromedriver from here
- Copy
chromedriver
binary to ${project_directory}/bin/ or add it to PATH.
3.3 Download and setup phantomjs [deprecated]
- Official phantomjs prebuilt executable can be downloaded from here
- Copy
phantomjs
to ${project_directory}/bin/ or add it to PATH.
3.4 Install python packages
pip3 install -r requirements.txt
4. Usage
4.1 GUI
Run image_downloader_gui.py
script to yank GUI:
python image_downloader_gui.py
4.2 CMD
usage: image_downloader.py [-h] [--engine {Google,Bing,Baidu}]
[--driver {chrome_headless,chrome,phantomjs}]
[--max-number MAX_NUMBER]
[--num-threads NUM_THREADS] [--timeout TIMEOUT]
[--output OUTPUT] [--safe-mode] [--face-only]
[--proxy_http PROXY_HTTP]
[--proxy_socks5 PROXY_SOCKS5]
keywords
License
- MIT License
- 996ICU License
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].