NathanWorkman / Seeker
Seeker - another job board aggregator.
Stars: ✭ 16
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Seeker
Funpyspidersearchengine
Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
Stars: ✭ 782 (+4787.5%)
Mutual labels: spider, scrapy, django
Py Elasticsearch Django
基于python语言开发的千万级别搜索引擎
Stars: ✭ 207 (+1193.75%)
Mutual labels: spider, scrapy, django
Django Dynamic Scraper
Creating Scrapy scrapers via the Django admin interface
Stars: ✭ 1,024 (+6300%)
Mutual labels: spider, scrapy, django
Python Spider
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
Stars: ✭ 615 (+3743.75%)
Mutual labels: spider, scrapy, django
Copybook
用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站
Stars: ✭ 117 (+631.25%)
Mutual labels: spider, scrapy, django
Gerapy
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
Stars: ✭ 2,601 (+16156.25%)
Mutual labels: spider, scrapy, django
PttImageSpider
PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)
Stars: ✭ 16 (+0%)
Mutual labels: spider, scrapy
scrapy facebooker
Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (+37.5%)
Mutual labels: spider, scrapy
ip proxy pool
Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.
Stars: ✭ 39 (+143.75%)
Mutual labels: spider, scrapy
Elves
🎊 Design and implement of lightweight crawler framework.
Stars: ✭ 315 (+1868.75%)
Mutual labels: spider, scrapy
Alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
Stars: ✭ 277 (+1631.25%)
Mutual labels: spider, scrapy
Haipproxy
💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+31106.25%)
Mutual labels: spider, scrapy
Seeker - [WIP]
Seeker is a job board aggregator. Check multiple job boards for positions you might be interested in and organize them all in one convenient location.
This project is a WIP. If you find a bug or would like a new spider/feature added please open a pull request.
⚙️ Setup
Docker
The easiest way to get started is to clone this repo and run docker-compose:
git clone [email protected]:NathanWorkman/seeker.git
cd seeker/
docker-compose build
docker-compose up
To run the spiders
Execute the individual spiders from inside the docker container
docker exec -it seeker_app scrapy crawl spidername
or run all the spiders at once:
docker exec -it seeker_app python crawl.py
Navigate to 0.0.0.0:8000 to view results.
💻 Job Boards
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].