Asoul / Tsec
台灣上市上櫃股票爬蟲 Taiwan Stock Exchange Crawler
Stars: ✭ 327
Projects that are alternatives of or similar to Tsec
Tsrtc
台灣股票即時爬蟲。Taiwan Stock Exchange Real Time Crawler
Stars: ✭ 359 (+9.79%)
Mutual labels: taiwan, crawler, stock
Examples Of Web Crawlers
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Stars: ✭ 10,724 (+3179.51%)
Mutual labels: crawler, stock
Sina Stock Crawler
Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫
Stars: ✭ 12 (-96.33%)
Mutual labels: crawler, stock
twse-captcha-solver-dl4j
A deeplearning based captcha solver for http://bsr.twse.com.tw/bshtm/
Stars: ✭ 29 (-91.13%)
Mutual labels: taiwan, stock
Grs
📈 台灣上市上櫃股票價格擷取（Fetch Taiwan Stock Exchange data）含即時盤、台灣時間轉換、開休市判斷。
Stars: ✭ 405 (+23.85%)
Mutual labels: taiwan, stock
Taiwan News Crawlers
Scrapy-based Crawlers for news of Taiwan
Stars: ✭ 83 (-74.62%)
Mutual labels: taiwan, crawler
sse-option-crawler
SSE 50 index options crawler 上证50期权数据爬虫
Stars: ✭ 17 (-94.8%)
Mutual labels: crawler, stock
Dotnetspider
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Stars: ✭ 3,233 (+888.69%)
Mutual labels: crawler
Gopa
[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Stars: ✭ 277 (-15.29%)
Mutual labels: crawler
Crawlertutorial
爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例
Stars: ✭ 282 (-13.76%)
Mutual labels: crawler
Hacker News Digest
📰 A responsive interface of Hacker News with summaries and thumbnails.
Stars: ✭ 278 (-14.98%)
Mutual labels: crawler
Dom Crawler
The DomCrawler component eases DOM navigation for HTML and XML documents.
Stars: ✭ 3,499 (+970.03%)
Mutual labels: crawler
Klinechart
📈Lightweight k-line chart that can be highly customized. Zero dependencies. Support mobile.（可高度自定义的轻量级k线图，无第三方依赖，支持移动端）
Stars: ✭ 303 (-7.34%)
Mutual labels: stock
Ghcrawler
Crawl GitHub APIs and store the discovered orgs, repos, commits, ...
Stars: ✭ 293 (-10.4%)
Mutual labels: crawler
Python Automation Scripts
Simple yet powerful automation stuffs.
Stars: ✭ 292 (-10.7%)
Mutual labels: crawler
Taiwan Stock Exchange Crawler
這是一個去爬 台灣證券交易所 和 證券櫃檯買賣中心 的爬蟲，秉持著 Open Data 的理念，公開爬蟲公開資料最安心。
Note
有問題的話可以到 Gitter.im 發問，會盡快回答
Setup
$ git clone https://github.com/Asoul/tsec.git
$ cd tsec
$ pip install -r requirements.txt
Usage
Command
爬當日
$ python crawl.py
爬指定日期
$ python crawl.py YYYY MM DD
e.g.
$ python crawl.py 2016 02 15
Flag
-b, --back: 往回爬直到 2004/2/11
-c, --check: 往回爬 10 天
後處理
清除重複的檔案，按日期排序
$ python post_process.py
資料格式
- 每個檔案的檔名
XXX.csv，XXX是股票編號 - 每個檔案中有數列，每列為一天交易的資訊
- 每列包含：交易日期、成交股數、成交金額、開盤價、最高價、最低價、收盤價、漲跌價差、成交筆數，共 9 欄。
- 符號說明: +表示漲、- 表示跌、X表示不比價
- 當日統計資訊含一般、零股、盤後定價、鉅額交易，不含拍賣、標購。
範例：104/02/13,7599922.0,528270219.0,69.35,69.65,69.35,69.45,0.45,1771.0
資料來源
附上免責聲明
本人旨在為廣大投資人提供正確可靠之資訊及最好之服務，作為投資研究的參考依據，若因任何資料之不正確或疏漏所衍生之損害或損失，本人將不負法律責任。是否經由本網站使用下載或取得任何資料，應由您自行考量且自負風險，因任何資料之下載而導致您電腦系統之任何損壞或資料流失，您應負完全責任。
聯絡我
有 Bug 麻煩跟我說：
最後更新時間：2017/02/15
我的其他專案
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].