All Projects → jaxBCD → Ultimate Dork

jaxBCD / Ultimate Dork

Web Crawler

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Ultimate Dork

ComicBookMaker
Script to fetch webcomics and use them to create ebooks.
Stars: ✭ 27 (-65.82%)
Mutual labels:  web-crawler
Spider Flow
新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Stars: ✭ 365 (+362.03%)
Mutual labels:  web-crawler
Crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Stars: ✭ 8,392 (+10522.78%)
Mutual labels:  web-crawler
Lagoujob
Job data mining repo for lagou.com
Stars: ✭ 256 (+224.05%)
Mutual labels:  web-crawler
Ache
ACHE is a web crawler for domain-specific search.
Stars: ✭ 320 (+305.06%)
Mutual labels:  web-crawler
Spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+730.38%)
Mutual labels:  web-crawler
flink-crawler
Continuous scalable web crawler built on top of Flink and crawler-commons
Stars: ✭ 48 (-39.24%)
Mutual labels:  web-crawler
Cvpr2019
Displays all the 2019 CVPR Accepted Papers in a way that they are easy to parse.
Stars: ✭ 65 (-17.72%)
Mutual labels:  web-crawler
Sparkler
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
Stars: ✭ 362 (+358.23%)
Mutual labels:  web-crawler
Maman
Rust Web Crawler saving pages on Redis
Stars: ✭ 39 (-50.63%)
Mutual labels:  web-crawler
Spidy
The simple, easy to use command line web crawler.
Stars: ✭ 257 (+225.32%)
Mutual labels:  web-crawler
Supercrawler
A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.
Stars: ✭ 306 (+287.34%)
Mutual labels:  web-crawler
Storm Crawler
A scalable, mature and versatile web crawler based on Apache Storm
Stars: ✭ 703 (+789.87%)
Mutual labels:  web-crawler
UnChain
A tool to find redirection chains in multiple URLs
Stars: ✭ 77 (-2.53%)
Mutual labels:  web-crawler
Terpene Profile Parser For Cannabis Strains
Parser and database to index the terpene profile of different strains of Cannabis from online databases
Stars: ✭ 63 (-20.25%)
Mutual labels:  web-crawler
CrawlBox
Easy way to brute-force web directory.
Stars: ✭ 118 (+49.37%)
Mutual labels:  web-crawler
Awesome Crawler
A collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+5967.09%)
Mutual labels:  web-crawler
Ospider
开源矢量地理数据获取与预处理工具(POI/AOI/行政区/路网/土地利用)
Stars: ✭ 74 (-6.33%)
Mutual labels:  web-crawler
Abotx
Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
Stars: ✭ 63 (-20.25%)
Mutual labels:  web-crawler
Dutsso
快速登录大连理工大学统一身份认证系统(SSO)的Python模块,可轻松实现成绩提醒、抢课、玉兰卡信息、个人信息查询等功能。
Stars: ✭ 32 (-59.49%)
Mutual labels:  web-crawler

Ultimate-Dork Python|3.7

web crawler And Scan SQL injection vulnerability

Usage & Installation

- Installation
apt-get install python python3 git
git clone https://github.com/jaxBCD/Ultimate-Dork.git
python3 -m pip install requests mechanicalsoup 
cd Ultimate-Dork

 - Usage 
 python3 ultimate-dork.py -h *show help and description
 
* Default Crawling
python3 ultimate-dork.py --dork keyword 
 
 * with Scan SQLi vulnerability
 python3 ultimate-dork.py --dork keyword --scan

 * with Proxy
 python3 ultimate-dork.py --dork keyword --proxy 0.0.0.0:1337
 
 

[ update ] : 19 March 2019

COPYRIGHT©2019 https://github.com/jaxBCD

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].