All Projects → klren0312 → ZSpider

klren0312 / ZSpider

Licence: other
基于Electron爬虫程序

Programming Languages

Vue
7211 projects
javascript
184084 projects - #8 most used programming language
SCSS
7915 projects
HTML
75241 projects

Projects that are alternatives of or similar to ZSpider

spider
A web spider framework
Stars: ✭ 25 (-32.43%)
Mutual labels:  spider, puppeteer
Linkedin Profile Scraper
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+362.16%)
Mutual labels:  spider, puppeteer
Webster
a reliable high-level web crawling & scraping framework for Node.js.
Stars: ✭ 364 (+883.78%)
Mutual labels:  spider, puppeteer
Chromium for spider
dynamic crawler for web vulnerability scanner
Stars: ✭ 220 (+494.59%)
Mutual labels:  spider, puppeteer
Puppeteer Walker
a puppeteer walker 🕷 🕸
Stars: ✭ 78 (+110.81%)
Mutual labels:  spider, puppeteer
Ppspider
web spider built by puppeteer, support task-queue and task-scheduling by decorators,support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架,提供灵活的任务队列管理调度方案,提供便捷的数据保存方案(nedb/mongodb),提供数据可视化和用户交互的实现方案
Stars: ✭ 237 (+540.54%)
Mutual labels:  spider, puppeteer
puppeteer-serverless
Puppeteer for both serverless functions and development.
Stars: ✭ 28 (-24.32%)
Mutual labels:  puppeteer
gospider
⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
Stars: ✭ 183 (+394.59%)
Mutual labels:  spider
mermaid.ink
Given a mermaid code (markdown-like), serve an image for you
Stars: ✭ 43 (+16.22%)
Mutual labels:  puppeteer
NUSISS-DevOpsEng
NUS ISS DevOps Engineering - Git, Docker, Docker Compose, Puppet , AWS Code Pipeline/CodeStar, Docker , Kubernetes, Terraform, Ansible
Stars: ✭ 58 (+56.76%)
Mutual labels:  puppeteer
TaobaoSpider
This taobao spider has been archived
Stars: ✭ 28 (-24.32%)
Mutual labels:  spider
grapy
Grapy, a fast high-level web crawling framework for Python 3.3 or later base on asyncio.
Stars: ✭ 18 (-51.35%)
Mutual labels:  spider
Web-Iota
Iota is a web scraper which can find all of the images and links/suburls on a webpage
Stars: ✭ 60 (+62.16%)
Mutual labels:  spider
apify-cli
Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.
Stars: ✭ 37 (+0%)
Mutual labels:  puppeteer
crawler-chrome-extensions
爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
Stars: ✭ 53 (+43.24%)
Mutual labels:  spider
bilibili-smallvideo
🕷️用于爬取B站前top100的小视频
Stars: ✭ 133 (+259.46%)
Mutual labels:  spider
codepen-puppeteer
Use Puppeteer to download pens from Codepen.io as single html pages
Stars: ✭ 22 (-40.54%)
Mutual labels:  puppeteer
playwright-demos
playwright for scrapping and UI testing / automate testing workflows
Stars: ✭ 65 (+75.68%)
Mutual labels:  puppeteer
mongood
A MongoDB GUI with Fluent Design
Stars: ✭ 674 (+1721.62%)
Mutual labels:  monaco-editor
weixin article spiders
A spiders' program for weixin which made by Express & cheerio
Stars: ✭ 33 (-10.81%)
Mutual labels:  spider

治电爬虫程序

功能

  • 夜间模式
  • 创建/修改应用
  • 导入/导出应用
  • 数据采集
  • 数据发布 (MySQL), 可导出Excel, JSON文件
  • 本地应用上传, 远程应用获取
  • 客户端与服务端通信
  • 新增代码应用
  • 插入代码片段功能

开发与打包

# install dependencies
npm install

# serve with hot reload at localhost:9080
npm run serve

# build electron application for production
npm run build


# lint all JS/Vue component files in `src/`
npm run lint

相关问题

1.导入示例应用

a.文件夹名称: example

b.应用:

  • house365应用.zpk
  • 代码测试应用.zpk

c.导入 在主页面点击导入应用, 选取.zpk文件导入即可

2.代码应用相关调用类库和方法

{ name: 'fs', info: 'NodeJS内置文件操作库' }
{ name: 'path', info: 'NodeJS内置路径操作库' }
{ name: 'reqest', info: 'HTTP请求库' }
{ name: 'request-promise', info: '基于Promise的HTTP请求库' }
{ name: 'cheerio', info: 'HTML解析库' }
{ name: 'cheerio-tableparser', info: 'HTML表格解析的Cheerio插件' }
{ name: 'mysql2', info: 'MySQL操作库' }
{ name: 'puppeteer-core', info: '操作Chrome库' }
{ name: 'electron', info: '操作Electron窗体相关API' }
{ name: 'dataDb', info: '操作本地JSON数据存储, 用于本地存储数据' }
{ name: 'chromePath', info: '本地Chrome安装路径' }

运行截图

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].