All Projects → sedgwickz → jsonHunter

sedgwickz / jsonHunter

Licence: MIT license
在线爬虫,online web scraper

Programming Languages

typescript
32286 projects
javascript
184084 projects - #8 most used programming language
CSS
56736 projects

Labels

Projects that are alternatives of or similar to jsonHunter

LinkedIn-Scraper
A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!
Stars: ✭ 62 (-27.91%)
Mutual labels:  scraper
Image-Scraper
Fast concurrent image scraper
Stars: ✭ 35 (-59.3%)
Mutual labels:  scraper
linkedin-employee-scraper
Extract all employees from LinkedIn. Especially useful for companies with thousands of employees.
Stars: ✭ 16 (-81.4%)
Mutual labels:  scraper
dorkscout
DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets
Stars: ✭ 189 (+119.77%)
Mutual labels:  scraper
MalScraper
Scrape everything you can from MyAnimeList.net
Stars: ✭ 132 (+53.49%)
Mutual labels:  scraper
youtube-trending-videos-scraper
A scraper for videos that are trending on YouTube (https://www.youtube.com/feed/trending)
Stars: ✭ 21 (-75.58%)
Mutual labels:  scraper
Recipe-Scraper
A JS package for scraping recipes from the web.
Stars: ✭ 78 (-9.3%)
Mutual labels:  scraper
instagram-hashtag-scraper
NodeJS application for scraping recent top posts from Instagram by hashtag without API access.
Stars: ✭ 17 (-80.23%)
Mutual labels:  scraper
immo-feed
A extensible app for scraping property listings
Stars: ✭ 35 (-59.3%)
Mutual labels:  scraper
YT-DLP-SCRIPTS
...Just a place for me to share my various YT-DLP & related bash scripts.
Stars: ✭ 70 (-18.6%)
Mutual labels:  scraper
TikTokDownloader PyWebIO
🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+968.6%)
Mutual labels:  scraper
EsriRESTScraper
A Python class that scrapes ESRI Rest Endpoints and exports data to a geodatabase
Stars: ✭ 43 (-50%)
Mutual labels:  scraper
nest-crawler
An easiest crawling and scraping module for NestJS
Stars: ✭ 45 (-47.67%)
Mutual labels:  scraper
ceiba-dl
NTU CEIBA 資料下載工具
Stars: ✭ 80 (-6.98%)
Mutual labels:  scraper
lux
👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 19,266 (+22302.33%)
Mutual labels:  scraper
4scanner
Continuously search imageboards threads for images/webms and download them
Stars: ✭ 103 (+19.77%)
Mutual labels:  scraper
TinderBotz
Automated Tinder bot and scraper using selenium in python.
Stars: ✭ 265 (+208.14%)
Mutual labels:  scraper
rymscraper
Python API to extract data from rateyourmusic.com.
Stars: ✭ 63 (-26.74%)
Mutual labels:  scraper
flickr scraper
Simple Flickr Image Scraper
Stars: ✭ 148 (+72.09%)
Mutual labels:  scraper
stream-list-updater
Automation for updating an index of live George Floyd protest streams
Stars: ✭ 15 (-82.56%)
Mutual labels:  scraper

JSONHunter

介绍

JSONHunter 可以帮助你快速获取某网站指定元素,实现类似爬虫或者获取 JSON PlaceHolder 效果。

在线网站

演示

使用说明

事例 1:获取 v2ex 首页贴子标题

[
    {
        "name": ".topic-link",
        "alias": "title"
    }
]

事例 2: 获取 v2ex 首页贴子标题及链接,发帖人及链接,以及发表时间

[
    {
        "name": ".topic-link",
        "attrs": [
        "href"
        ]
    },
    {
        "name": ".topic_info strong:first-of-type a",
        "attrs": [
        "href"
        ]
    },
    {
        "name": ".topic_info span"
    }
]

⚠️ 注意:目前支持的选择器如下

*  任何元素

E  任何类型E的元素

E:nth-child(n)  一个E元素,其父元素的第n个子元素

E:first-child  一个E元素,其父元素的第一个孩子

E:nth-of-type(n)  E元素,其类型的第n个同级

E:first-of-type  E元素,其类型的第一个同级

E:not(s)  与两个复合选择器都不匹配的E元素

E.warning  属于类警告的E元素

E#myid  ID等于myid的E元素。

E[foo]  具有foo属性的E元素

E[foo="bar"]  一个E元素,其foo属性值完全等于bar

E[foo="bar" i]  一个E元素,其foo属性值完全等于bar的任何(ASCII范围)大小写排列

E[foo="bar" s]  一个E元素,其foo属性值与大小写精确且等于bar

E[foo~="bar"]  一个E元素,其foo属性值是由空格分隔的值的列表,其中一个值等于bar

E[foo^="bar"]  一个E元素,其foo属性值完全以字符串bar开头

E[foo$="bar"]  一个E元素,其foo属性值恰好以字符串bar结尾

E[foo*="bar"]  一个E元素,其foo属性值包含子字符串栏

E[foo|="en"]  一个E元素,其foo属性值是用en开头的连字符分隔的值列表

E F  E元素的F元素后代

E > F  E元素的F元素子元素

API 说明


字段名 类型 是否必填
name string required
alias string optional
attrs array optional

License

MIT

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].