IcrawlerA multi-thread crawler framework with many builtin image crawlers provided.
Stars: ✭ 629 (-46.38%)
Sou简单搜索,一个简单的前端界面。用惯了各种导航首页,满屏幕尽是各种不厌其烦的广告和资讯;尝试自己写个自己的主页。
Stars: ✭ 628 (-46.46%)
MtransMulti-source Translation
Stars: ✭ 711 (-39.39%)
Magic googleGoogle search results crawler, get google search results that you need
Stars: ✭ 247 (-78.94%)
Happy Spiders🔧 🔩 🔨 收集整理了爬虫相关的工具、模拟登陆技术、代理IP、scrapy模板代码等内容。
Stars: ✭ 261 (-77.75%)
Dc SdkDC-SDK 是基于 Cesium 进行二次开发的2、3D一体 WebGis 应用框架,该框架优化了 Cesium 的使用方式和增添了一些额外功能,旨在为开发者快速构建 WebGis 应用。🌎
Stars: ✭ 206 (-82.44%)
SeekerSeeker - another job board aggregator.
Stars: ✭ 16 (-98.64%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (-54.31%)
Python Spider豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
Stars: ✭ 615 (-47.57%)
Hivelots of spider (很多爬虫)
Stars: ✭ 110 (-90.62%)
Haipproxy💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+325.66%)
Feapderfeapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架
Stars: ✭ 110 (-90.62%)
Crawlab LiteLite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (-89.6%)
PttImageSpiderPTT 圖片下載器 (抓取整個看板的圖片,並用文章標題作為資料夾的名稱 ) (使用Scrapy)
Stars: ✭ 16 (-98.64%)
Search DeflectorA small program that forwards searches from Cortana to your preferred browser and search engine.
Stars: ✭ 620 (-47.14%)
FunpyspidersearchengineWord2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
Stars: ✭ 782 (-33.33%)
BeanbunBeanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性,基于 Workerman。
Stars: ✭ 1,096 (-6.56%)
Super Spider根据腾讯安全应急响应中心的架构编写的一款超强爬虫(广度优先搜索)
Stars: ✭ 48 (-95.91%)
Musicbox😊 🎵 MusicPlayer 一站式收听多平台音乐(网易云, 虾米, QQ)的跨平台音乐播放器,尽情享受吧~✨
Stars: ✭ 1,130 (-3.67%)
Vscode Qt For PythonQt for Python (PyQt5 and PySide2) extension for Visual Studio Code.
Stars: ✭ 47 (-95.99%)
ShellphishPhishing Tool for 18 social media: Instagram, Facebook, Snapchat, Github, Twitter, Yahoo, Protonmail, Spotify, Netflix, Linkedin, Wordpress, Origin, Steam, Microsoft, InstaFollowers, Gitlab, Pinterest
Stars: ✭ 1,037 (-11.59%)
Pega Helm ChartsOrchestrate a Pega Platform™ deployment by using Docker, Kubernetes, and Helm to take advantage of Pega Platform Cloud Choice flexibility.
Stars: ✭ 58 (-95.06%)
MobiusScripts to extract data from the COVID-19 Google Community Mobility Reports
Stars: ✭ 47 (-95.99%)
Picacg Windows哔咔漫画window客户端,界面使用PySide2,已实现分类、搜索、收藏夹、下载、在线观看、waifu2x等功能。
Stars: ✭ 35 (-97.02%)
Novel Plus小说精品屋-plus是一个多端(PC、WAP)阅读、功能完善的原创文学CMS系统,由前台门户系统、作家后台管理系统、平台后台管理系统、爬虫管理系统等多个子系统构成,支持多模版、会员充值、订阅模式、新闻发布和实时统计报表等功能,新书自动入库,老书自动更新。
Stars: ✭ 1,122 (-4.35%)
UpyideMicropython IDE
Stars: ✭ 57 (-95.14%)
Wescraper依赖Scrapy和搜狗搜索微信公众号文章
Stars: ✭ 46 (-96.08%)
Google Search SidebarA user script and user style to move Google search tools to sidebar.
Stars: ✭ 46 (-96.08%)
YavipcoreNet Core Music Interface
Stars: ✭ 1,095 (-6.65%)
Nemiro.oauth.dllNemiro.OAuth is a class library for authorization via OAuth protocol in .NET Framework
Stars: ✭ 45 (-96.16%)
Warta ScrapIndonesia Index News Crawler, including 10 online media
Stars: ✭ 57 (-95.14%)
ApkupdaterAPKUpdater is an open source tool that simplifies the process of finding updates for your installed apps.
Stars: ✭ 1,028 (-12.36%)
Bitcoin Info ActionApp for the google assistant that give you information on bitcoin (e.g. price, market cap etc')
Stars: ✭ 45 (-96.16%)
ArachnidPowerful web scraping framework for Crystal
Stars: ✭ 68 (-94.2%)
Scrapy S3pipelineScrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.
Stars: ✭ 57 (-95.14%)
Ingress GceIngress controller for Google Cloud
Stars: ✭ 1,024 (-12.7%)
Car PricesGolang爬虫 爬取汽车之家 二手车产品库
Stars: ✭ 57 (-95.14%)
FbiwarningNode.js seed downloader (Node.js 种子神器)
Stars: ✭ 44 (-96.25%)
Awesome Python Primer自学入门 Python 优质中文资源索引,包含 书籍 / 文档 / 视频,适用于 爬虫 / Web / 数据分析 / 机器学习 方向
Stars: ✭ 57 (-95.14%)
PhotonIncredibly fast crawler designed for OSINT.
Stars: ✭ 8,332 (+610.32%)
Netcore Postgres Oauth BoilerA basic .NET Core website boilerplate using PostgreSQL for storage, Adminer for db management, Let's Encrypt for SSL certificates and NGINX for routing.
Stars: ✭ 57 (-95.14%)