sidrarA R interface to IBGE's SIDRA API
Stars: ✭ 49 (+40%)
Gifhub📈 Create GIFs from user's GitHub activity graph
Stars: ✭ 17 (-51.43%)
scrapmanRetrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs
Stars: ✭ 21 (-40%)
DuckduckgoAn unofficial DuckDuckGo search API.
Stars: ✭ 6 (-82.86%)
cs-wordpress-bouncerCrowdSec is an open-source cyber security tool. This plugin blocks detected attackers or display them a captcha to check they are not bots.
Stars: ✭ 25 (-28.57%)
Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+2154.29%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+271.43%)
InformerA Telegram Mass Surveillance Bot in Python
Stars: ✭ 745 (+2028.57%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+1774.29%)
Raid-Protect-Discord-BotA Discord Bot that allows you to protect your Discord server with captcha, anti profanity, anti nudity image, anti spam, account age required, logs...
Stars: ✭ 182 (+420%)
Instagram CrawlerGet Instagram posts/profile/hashtag data without using Instagram API
Stars: ✭ 643 (+1737.14%)
Chinese laws本项目旨在收集中国人民共和国的各类法律条文;项目重启中,期望PR
Stars: ✭ 245 (+600%)
Scala ScraperA Scala library for scraping content from HTML pages
Stars: ✭ 631 (+1702.86%)
GChanScrape boards and threads from 4chan (8kun WIP). Downloads images, videos and HTML if desired.
Stars: ✭ 31 (-11.43%)
Instagram4j📷 Instagram private API in Java
Stars: ✭ 629 (+1697.14%)
Choosealicense.comA site to provide non-judgmental guidance on choosing a license for your open source project
Stars: ✭ 2,648 (+7465.71%)
CheerioFast, flexible, and lean implementation of core jQuery designed specifically for the server.
Stars: ✭ 24,616 (+70231.43%)
EasyShiro基于 RBAC 模型功能全面的 Shiro 安全集成&简化&扩展组件。Shiro integration & simplifies & Extension component based RBAC
Stars: ✭ 47 (+34.29%)
Instagram ScraperScrapes an instagram user's photos and videos
Stars: ✭ 5,664 (+16082.86%)
Crawler illegal cases in chinaCollection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律,避免触碰数据合规红线。 [AD]中文知识图谱门户
Stars: ✭ 2,448 (+6894.29%)
GoogledictionaryapiGoogle does not provide Google Dictionary API so I created one.
Stars: ✭ 528 (+1408.57%)
extract-emailsExtract emails from a given website
Stars: ✭ 58 (+65.71%)
Operative Frameworkoperative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
Stars: ✭ 511 (+1360%)
Parselawdocuments对收集的法律文档进行一系列分析,包括根据规范自动切分、案件相似度计算、案件聚类、法律条文推荐等(试验目前基于婚姻类案件,可扩展至其它领域)。
Stars: ✭ 138 (+294.29%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+13594.29%)
scraperNode.js based scraper using headless chrome
Stars: ✭ 45 (+28.57%)
Mon EntrepriseL'assistant officiel de l'entrepreneur
Stars: ✭ 123 (+251.43%)
ScrapedinLinkedIn Scraper (currently working 2020)
Stars: ✭ 453 (+1194.29%)
RARBG-scraperWith Selenium headless browsing and CAPTCHA solving
Stars: ✭ 38 (+8.57%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (+1157.14%)
Pkulaw spider爬取北大法宝网http://www.pkulaw.cn/Case/
Stars: ✭ 113 (+222.86%)
Linkedin scraperA library that scrapes Linkedin for user data
Stars: ✭ 413 (+1080%)
instagram-hashtag-scraperNodeJS application for scraping recent top posts from Instagram by hashtag without API access.
Stars: ✭ 17 (-51.43%)
Php GooseReadability / Html Content / Article Extractor & Web Scrapping library written in PHP
Stars: ✭ 392 (+1020%)
Mycail中国法研杯-司法人工智能挑战赛
Stars: ✭ 60 (+71.43%)
scrapeerEssential PHP library that scrapes HTTP(S) and UDP trackers for torrent information.
Stars: ✭ 81 (+131.43%)
Scrape It🔮 A Node.js scraper for humans.
Stars: ✭ 3,773 (+10680%)
Site PolicyCollaborative development on GitHub's site policies, procedures, and guidelines
Stars: ✭ 797 (+2177.14%)
ScrapersA list of scrapers from around the web.
Stars: ✭ 366 (+945.71%)
city-codesBrazilian city names and official codes, IBGE, LexML and others
Stars: ✭ 39 (+11.43%)
Freshonions TorscraperFresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (+894.29%)
Blackstone⚫️ A spaCy pipeline and model for NLP on unstructured legal text.
Stars: ✭ 465 (+1228.57%)
XidelCommand line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Stars: ✭ 335 (+857.14%)
roseAnalyse all kinds of data for a TV series
Stars: ✭ 34 (-2.86%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+11548.57%)
CryptocmdCryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.
Stars: ✭ 299 (+754.29%)
lux👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 19,266 (+54945.71%)
InstaloctrackAn Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.
Stars: ✭ 85 (+142.86%)
dreO projecto agora reside no GitLab
Stars: ✭ 20 (-42.86%)
municipios-brDados em formato aberto sobre municípios e unidades federativas do Brasil.
Stars: ✭ 58 (+65.71%)
mCaptchaA no-nonsense CAPTCHA system with seamless UX | Backend component
Stars: ✭ 473 (+1251.43%)
covid19-br-infoCoronavirus frontend info about Brazil's states and cities
Stars: ✭ 12 (-65.71%)
freeDictionaryAPIThere was no free Dictionary API on the web when I wanted one for my friend, so I created one.
Stars: ✭ 1,352 (+3762.86%)
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (+85.71%)
gesetze-toolsScripts to maintain German law git repository
Stars: ✭ 99 (+182.86%)
captcha-minicaptcha-mini.js是一个生成验证码的插件,使用js和canvas生成的,确保后端服务被暴力攻击,简单判断人机以及系统的安全性,体积小,功能多,支持配置。展示地址:https://www.mwcxs.top/static/testTool/demo/index.html
Stars: ✭ 98 (+180%)