savepagenowA simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service
Stars: ✭ 140 (-58.58%)
glyphhangerYour web font utility belt. It can subset web fonts. It can find unicode-ranges for you automatically. It makes julienne fries.
Stars: ✭ 422 (+24.85%)
L-SpiderA DHT Spider allows you to sniff the torrents and magnets.You can download them directly.
Stars: ✭ 64 (-81.07%)
UrlgrabA golang utility to spider through a website searching for additional links.
Stars: ✭ 285 (-15.68%)
NewsPinNews app for android using Kotlin, coroutines, MVP architecture
Stars: ✭ 25 (-92.6%)
trafilaturaPython & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
Stars: ✭ 711 (+110.36%)
dispatchA publishing platform for modern newspapers.
Stars: ✭ 62 (-81.66%)
bot-javaNo description or website provided.
Stars: ✭ 17 (-94.97%)
apple-newsA Node.js client for interacting with the Apple News API 📰
Stars: ✭ 34 (-89.94%)
gathertoolgathertool是golang脚本化开发库,目的是提高对应场景程序开发的效率;轻量级爬虫库,接口测试&压力测试库,DB操作库等。
Stars: ✭ 36 (-89.35%)
araneid一个基于Glang语言开发的站群系统(蜘蛛池系统)
Stars: ✭ 25 (-92.6%)
Douban CrawlerUno Crawler por https://douban.com
Stars: ✭ 13 (-96.15%)
spark-gdeltBinding the GDELT universe in a Spark environment
Stars: ✭ 20 (-94.08%)
pynytimesUse all the New York Times APIs in Python!
Stars: ✭ 22 (-93.49%)
ZSpider基于Electron爬虫程序
Stars: ✭ 37 (-89.05%)
douyin-api抖音接口、抖音API、抖音数据爬虫、抖音直播数据、抖音直播Api、抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析、抖音直播监控、抖音数据采集
Stars: ✭ 41 (-87.87%)
v2rayV2ray看新闻,自动抓取可用节点,以V2ray的机制上网看新闻
Stars: ✭ 44 (-86.98%)
newsdashA news dashboard inspired by iGoogle and Netvibes
Stars: ✭ 44 (-86.98%)
nivinEdu拟物校园,一个开源的高校教务移动化解决方案。
Stars: ✭ 24 (-92.9%)
gospider⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
Stars: ✭ 183 (-45.86%)
SupercrawlerA web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.
Stars: ✭ 306 (-9.47%)
main project基于nodejs的网络聊天室、爬虫,vue音乐播放器,及php后台开发的管理系统等项目
Stars: ✭ 49 (-85.5%)
rb-spider基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing]
Stars: ✭ 13 (-96.15%)
info-bot🤖 A Versatile Telegram Bot
Stars: ✭ 37 (-89.05%)
ip proxy poolGenerating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.
Stars: ✭ 39 (-88.46%)
fastlane-plugin-slack botA Fastlane plugin to customize your automation workflow(s) with a Slack Bot 🤖🚀
Stars: ✭ 26 (-92.31%)
zucc xk ZhengFangZUCC正方教务系统抢课助手。针对ZUCC正方教务系统模拟登录,爬取课程信息,自动抓包发包抢课。具体实现流程可参考README中的实现原理链接
Stars: ✭ 40 (-88.17%)
scrapy helperDynamic configurable crawl (动态可配置化爬虫)
Stars: ✭ 84 (-75.15%)
pipelineThe Polytechnic's content management system
Stars: ✭ 17 (-94.97%)
vuejs-newsSingle page app that pulls in news from NYTimes
Stars: ✭ 19 (-94.38%)
Android-WeeklyAndroid Weekly is a free newsletter that helps you to stay cutting-edge with your Android Development. The newsletter comes once a week and covers a broad range of topics like tutorials, screencasts, news... just everything that's awesome in the Android Development world!
Stars: ✭ 66 (-80.47%)
spider裁判文书网爬虫
Stars: ✭ 19 (-94.38%)
Tsec台灣上市上櫃股票爬蟲 Taiwan Stock Exchange Crawler
Stars: ✭ 327 (-3.25%)
client-jsDemonstration of using the api in javascript
Stars: ✭ 20 (-94.08%)
indieweb-searchSource code for the IndieWeb search engine.
Stars: ✭ 16 (-95.27%)
TradeTheEventImplementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021
Stars: ✭ 64 (-81.07%)
jobSpiderjobSpider是一只scrapy爬虫,用于爬取职位信息
Stars: ✭ 28 (-91.72%)
simpyder超高速异步协程Python爬虫
Stars: ✭ 74 (-78.11%)
archiveisA simple Python wrapper for the archive.is capturing service
Stars: ✭ 152 (-55.03%)
NewsAppAn app that fetches latest news, headlines
Stars: ✭ 28 (-91.72%)
ChineseStarsRelationship中国明星数据爬取。你甚至可以拿到互联网上所有的人之间的关系,接下来你可以自己发挥!基于这些数据,你可以完成更多有趣的事情。比如说社交网络分析,关系网络可视化,算法研究,和其他有意思的事情。Chinese star data crawling. You can even get all the people on the internet! Based on these data, you can do more interesting things. For example, social network analysis, relational network visualization, algorithm research, and other interesting things.
Stars: ✭ 26 (-92.31%)
Localradio📻 LocalRadio is "Radio for Cord-Cutters" – a Software-Defined Radio (SDR) app for your Mac and mobile devices. With an inexpensive RTL-SDR USB device, LocalRadio provides a casual, home-based radio listening experience for your favorite local frequencies - FM broadcasts/free music/news/sports/weather/public safety & aviation scanner/etc.
Stars: ✭ 269 (-20.41%)
CrawlBoxEasy way to brute-force web directory.
Stars: ✭ 118 (-65.09%)
gnewsclientAn easy-to-use python client for Google News feeds.
Stars: ✭ 42 (-87.57%)
2017 PyConTW Talktw.pycon.org/2017/events/talk/314386410792550475/
Stars: ✭ 18 (-94.67%)
clinewsA CLI for reading the news and getting the latest headlines including search functionality. Supports over 70 sources.
Stars: ✭ 17 (-94.97%)