bots-zooNo description or website provided.
Stars: ✭ 59 (+391.67%)
mal-analysisgithub repo for MyAnimeList analysis. Also links to the MAL dataset.
Stars: ✭ 31 (+158.33%)
BrowserDo some browser detection with Ruby. Includes ActionController integration.
Stars: ✭ 2,263 (+18758.33%)
Crawler Detect🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Stars: ✭ 1,549 (+12808.33%)
User agentGenerator of User-Agent header
Stars: ✭ 227 (+1791.67%)
xXx dead xXxb̶̡̪̬͒l̸̰̗̝̀ỏ̷̡̩g̴͇̑g̶̲̱̽͐i̵̹͗n̶̤̥͂̅̆g̴̮̾̅͜ ̷̧͎͆i̷̛͒͜͠n̸̥̺͒ ̶͚͚͊̿͜t̸̺͙̭̆̊̈́ḧ̶̟́̐e̸̱͔̟̓̓͝ ̶̨͔̾͛̑d̵̥̣̏ȧ̷̼̊r̷̰̝̥̅̌͝k̵̟̥̞̉̍͛
Stars: ✭ 19 (+58.33%)
Agent orangeParse and process User Agents like a secret one
Stars: ✭ 127 (+958.33%)
browserslist-generatorA library that makes generating and validating Browserslists a breeze!
Stars: ✭ 77 (+541.67%)
Th3inspectorTh3Inspector 🕵️ Best Tool For Information Gathering 🔎
Stars: ✭ 1,041 (+8575%)
Ua Parser JsUAParser.js - Detect Browser, Engine, OS, CPU, and Device type/model from User-Agent data. Supports browser & node.js environment.
Stars: ✭ 6,421 (+53408.33%)
List Of User AgentsList of major web + mobile browser user agent strings. +1 Bonus script to scrape :)
Stars: ✭ 247 (+1958.33%)
auctusDataset search engine, discovering data from a variety of sources, profiling it, and allowing advanced queries on the index
Stars: ✭ 34 (+183.33%)
Mojo✨ Mojolicious - Perl real-time web framework
Stars: ✭ 2,298 (+19050%)
php-useragentA User-agent analyze project which written by PHP.
Stars: ✭ 83 (+591.67%)
React UseragentIntegrate user-agent detection in an idiomatic React way
Stars: ✭ 154 (+1183.33%)
socials👨👩👦 Social account detection and extraction in Python, e.g. for crawling/scraping.
Stars: ✭ 37 (+208.33%)
Fetch Plus🐕 Fetch+ is a convenient Fetch API replacement with first-class middleware support.
Stars: ✭ 116 (+866.67%)
zcrawlAn open source web crawling platform
Stars: ✭ 21 (+75%)
React Device DetectDetect device, and render view according to detected device type.
Stars: ✭ 1,145 (+9441.67%)
double-agentA test suite of common scraper detection techniques. See how detectable your scraper stack is.
Stars: ✭ 123 (+925%)
Browser DetectBrowser Detection for Laravel by hisorange!
Stars: ✭ 657 (+5375%)
robots-parserNodeJS robots.txt parser with support for wildcard (*) matching.
Stars: ✭ 117 (+875%)
puppet-masterPuppeteer as a service hosted on Saasify.
Stars: ✭ 25 (+108.33%)
Browser.phpA PHP Class to detect a user's Browser. This encapsulation provides a breakdown of the browser and the version of the browser using the browser's user-agent string. This is not a guaranteed solution but provides an overall accurate way to detect what browser a user is using.
Stars: ✭ 546 (+4450%)
YauaaYet Another UserAgent Analyzer
Stars: ✭ 472 (+3833.33%)
BaiduSpider项目已经移动至:https://github.com/BaiduSpider/BaiduSpider !! 一个爬取百度搜索结果的爬虫,目前支持百度网页搜索,百度图片搜索,百度知道搜索,百度视频搜索,百度资讯搜索,百度文库搜索,百度经验搜索和百度百科搜索。
Stars: ✭ 29 (+141.67%)
diffbot-php-client[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
Stars: ✭ 53 (+341.67%)
crawling-frameworkEasily crawl news portals or blog sites using Storm Crawler.
Stars: ✭ 22 (+83.33%)
the-seinfeld-chroniclesA dataset for textual analysis on arguably the best written comedy television show ever.
Stars: ✭ 14 (+16.67%)
Device Detector JsA precise user agent parser and device detector written in TypeScript
Stars: ✭ 193 (+1508.33%)
uach-retrofillThis snippet illustrates how to reconstruct the legacy navigator.userAgent string value from the modern navigator.userAgentData values.
Stars: ✭ 26 (+116.67%)
Device DetectorThe Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, mobile, tv, cars, console, etc.), brand and model.
Stars: ✭ 2,106 (+17450%)
useragent-generatorEasily generate correct user-agent strings for popular browsers
Stars: ✭ 62 (+416.67%)
Devicedetector.netThe Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, mobile, tv, cars, console, etc.), brand and model.
Stars: ✭ 144 (+1100%)
dxramA distributed in-memory key-value storage for billions of small objects.
Stars: ✭ 25 (+108.33%)
Parser PhpBrowser sniffing gone too far — A useragent parser library for PHP
Stars: ✭ 1,626 (+13450%)
tech-seo-crawlerBuild a small, 3 domain internet using Github pages and Wikipedia and construct a crawler to crawl, render, and index.
Stars: ✭ 57 (+375%)
proxycrawl-pythonProxyCrawl Python library for scraping and crawling
Stars: ✭ 51 (+325%)
Useragent.jsA User-agent analyze project.
Stars: ✭ 70 (+483.33%)
jsgraphDeprecated: Use the @encapsule/arccore package that includes the graph library
Stars: ✭ 42 (+250%)
Parser JavascriptBrowser sniffing gone too far — A useragent parser library for JavaScript
Stars: ✭ 66 (+450%)
VytalBrowser extension to spoof timezone, geolocation, locale and user agent.
Stars: ✭ 1,449 (+11975%)
Bugz🐛 Composable User Agent Detection using Ramda
Stars: ✭ 15 (+25%)
coreThe complete web scraping toolkit for PHP.
Stars: ✭ 1,110 (+9150%)
KolpaA fake data generator written in and for Go
Stars: ✭ 645 (+5275%)
telegram-crawler🕷 Automatically detect changes made to the official Telegram sites, clients and servers.
Stars: ✭ 84 (+600%)
User agentHTTP User Agent parser for the Go programming language.
Stars: ✭ 578 (+4716.67%)
User AgentsA JavaScript library for generating random user agents with data that's updated daily.
Stars: ✭ 485 (+3941.67%)
crawlerdetectGolang module to detect bots and crawlers via the user agent
Stars: ✭ 22 (+83.33%)
CurlA command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP, RTMPS, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET and TFTP. libcurl offers a myriad of powerful features
Stars: ✭ 22,875 (+190525%)
haroHaro is a modern immutable DataStore
Stars: ✭ 24 (+100%)
react-ua📱React User Agent Component, Hook, and HOC. SSR-ready, full UT, using new React Context and Hooks API
Stars: ✭ 18 (+50%)
user-agentUser-Agent parser for Clojure
Stars: ✭ 24 (+100%)
scrapy-fieldstatsA Scrapy extension to log items coverage when the spider shuts down
Stars: ✭ 17 (+41.67%)