Java Spider一个基于webmagic框架二次开发的java爬虫框架实战,已实现能爬取腾讯,搜狐,今日头条(单独集成功能)等资讯内容,配合elasticsearch框架用法,实现了自动爬虫,已投入线上生产使用。
Stars: ✭ 276 (-11.82%)
crawlerA simple and flexible web crawler framework for java.
Stars: ✭ 20 (-93.61%)
Hyperamp🎛 Humble music player
Stars: ✭ 293 (-6.39%)
wb wx zh tt新浪微博,微信,知乎,头条爬虫,支持新浪登录打码获取cookie实现登录
Stars: ✭ 16 (-94.89%)
Exaile🎶 Cross-platform music player
Stars: ✭ 270 (-13.74%)
talospidertalospider - A simple,lightweight scraping micro-framework
Stars: ✭ 57 (-81.79%)
PlylstSmart playlists for Spotify! Stop relying on fancy pants algorithms to organize your library and instead build playlists the way you want.
Stars: ✭ 301 (-3.83%)
web-data-extractorExtracting and parsing structured data with jQuery Selector, XPath or JsonPath from common web format like HTML, XML and JSON.
Stars: ✭ 52 (-83.39%)
Soundspice MobileA light-weight and minimalist music player for Android
Stars: ✭ 289 (-7.67%)
scrapy facebookerCollection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-92.97%)
BreadplayerBread Player, a free and open source music player powered by UWP and C#/.NET with a sleek and polished design built for, and by, the people seeking a better alternative to Groove and Windows Media Player by Microsoft.
Stars: ✭ 267 (-14.7%)
DhtspiderBittorrent dht network spider
Stars: ✭ 302 (-3.51%)
AthameAn extensible music download tool written in C#
Stars: ✭ 265 (-15.34%)
araneid一个基于Glang语言开发的站群系统(蜘蛛池系统)
Stars: ✭ 25 (-92.01%)
Projectsoundtracks🎧 List of best Soundtracks to boost your Productivity and Focus
Stars: ✭ 289 (-7.67%)
Z-Spider一些爬虫开发的技巧和案例
Stars: ✭ 33 (-89.46%)
Eyed3eyeD3 is a Python module and command line program for processing ID3 tags. Information about mp3 files (i.e bit rate, sample frequency, play time, etc.) is also provided. The formats supported are ID3v1 (1.0/1.1) and ID3v2 (2.3/2.4).
Stars: ✭ 300 (-4.15%)
Happy Spiders🔧 🔩 🔨 收集整理了爬虫相关的工具、模拟登陆技术、代理IP、scrapy模板代码等内容。
Stars: ✭ 261 (-16.61%)
zucc xk ZhengFangZUCC正方教务系统抢课助手。针对ZUCC正方教务系统模拟登录,爬取课程信息,自动抓包发包抢课。具体实现流程可参考README中的实现原理链接
Stars: ✭ 40 (-87.22%)
Gospidergolang实现的爬虫框架,使用者只需关心页面规则,提供web管理界面。基于colly开发。
Stars: ✭ 285 (-8.95%)
MusicSpiderMusic Spider. Go 👾 Music Spider 是使用Golang写的音乐聚合爬虫,目前支持的站点包括 网易、QQ、虾米、酷狗、百度。
Stars: ✭ 24 (-92.33%)
Dumpall一款信息泄漏利用工具,适用于.git/.svn源代码泄漏和.DS_Store泄漏
Stars: ✭ 250 (-20.13%)
youdao有道词典网页爬虫
Stars: ✭ 22 (-92.97%)
ZentunerA minimal chromatic tuner.
Stars: ✭ 308 (-1.6%)
benchmark-httpNo description or website provided.
Stars: ✭ 15 (-95.21%)
ZskyDHT磁力链接magnet BT搜索引擎,纯Python开发
Stars: ✭ 256 (-18.21%)
QQSpider爬取QQ用户信息(qq号、昵称、生日、地址等基本信息)并做简要analysis。
Stars: ✭ 21 (-93.29%)
Crawlertutorial爬蟲極簡教學(fetch, parse, search, multiprocessing, API)- PTT 為例
Stars: ✭ 282 (-9.9%)
douban-movieGet movie info from douban(豆瓣) and display in your terminal
Stars: ✭ 17 (-94.57%)
SpotiflyerSpotify/Gaana/Youtube Music Downloader For Android!
Stars: ✭ 231 (-26.2%)
OpenScraperAn open source webapp for scraping: towards a public service for webscraping
Stars: ✭ 80 (-74.44%)
Hacker News Digest📰 A responsive interface of Hacker News with summaries and thumbnails.
Stars: ✭ 278 (-11.18%)
ip proxy poolGenerating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.
Stars: ✭ 39 (-87.54%)
ToapiEvery web site provides APIs.
Stars: ✭ 3,209 (+925.24%)
spider🌟 powered by python3( simple learning of spider) 百度文库;网易云歌曲; 豆瓣电影; GitHub; 京东; QQ空间; 天气; vip解析助手; TED文本内容; wifi破解脚本; 必应图片设置为桌面等爬取
Stars: ✭ 124 (-60.38%)
163Music163music spider by scrapy.
Stars: ✭ 60 (-80.83%)
AlltheplacesA set of spiders and scrapers to extract location information from places that post their location on the internet.
Stars: ✭ 277 (-11.5%)
toutiao今日头条科技新闻接口爬虫
Stars: ✭ 17 (-94.57%)
Subbranch-China银行、支行名称。中国各地区各银行支行名称数据爬虫,数据来源微信商户平台,已经整理可直接导入的sql文件
Stars: ✭ 31 (-90.1%)
DaisyspA Powerful, Open Source DSP Library in C++
Stars: ✭ 291 (-7.03%)
Sina Spider新浪爬虫,基于Python+Selenium。模拟登陆后保存cookie,实现登录状态的保存。可以通过输入关键词来爬取到关键词相关的热门微博。
Stars: ✭ 25 (-92.01%)
Clementine🍊 Clementine Music Player
Stars: ✭ 3,089 (+886.9%)
JS-Crack-Records各大网站逆向demo。企名片、震坤行工业超市、天翼云登录、物超所值、瓜子二手车、马蜂窝、中华诗词库、澳门彩票、药智网、福建省招标投标在线监管平台、全国公共资源交易平台、问卷星、中国人民银行条法司、中华人民共和国公安部、AqiStudy、巨量星图、HeyTap、掌上高考、船讯网、百度指数、今日头条、知乎、七麦数据、途牛、七猫小说、企查查、同花顺、网易云音乐、拉勾招聘、玩物得志、房天下
Stars: ✭ 51 (-83.71%)
slime🍰 一个可视化的爬虫平台
Stars: ✭ 27 (-91.37%)