All Projects → evanleungc → ctrip_spider

evanleungc / ctrip_spider

Licence: other
Scrape Learning (ctrip)

Programming Languages

python
139335 projects - #7 most used programming language
javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to ctrip spider

Cookie Parser
Parse HTTP request cookies
Stars: ✭ 1,683 (+2085.71%)
Mutual labels:  cookie
Wkcookiewebview
WKWebView with cookie sharing support
Stars: ✭ 171 (+122.08%)
Mutual labels:  cookie
Supercookie
💭 Inspiration
Stars: ✭ 3,630 (+4614.29%)
Mutual labels:  cookie
Android Cookie Store
Android InMemory and persistent Cookie Store for HttpURLConnection and OkHttp, with extensions to easily sync cookies in Android WebViews.
Stars: ✭ 144 (+87.01%)
Mutual labels:  cookie
Sessions
Package gorilla/sessions provides cookie and filesystem sessions and infrastructure for custom session backends.
Stars: ✭ 2,148 (+2689.61%)
Mutual labels:  cookie
Forensic Tools
A collection of tools for forensic analysis
Stars: ✭ 204 (+164.94%)
Mutual labels:  cookie
Ngx Cookieconsent
Cookie 🍪 Consent module for Angular.
Stars: ✭ 120 (+55.84%)
Mutual labels:  cookie
minicrawler
Multiplexing web client supporting HTTP/2 and WHATWG URL compliant parser written in C
Stars: ✭ 21 (-72.73%)
Mutual labels:  cookie
Cookie.js
🍪 A simple, lightweight JavaScript API for handling browser cookies , it is easy to pick up and use, has a reasonable footprint(~2kb, gzipped: 0.95kb), and has no dependencies. It should not interfere with any JavaScript libraries or frameworks. https://npm.im/cookiejs
Stars: ✭ 166 (+115.58%)
Mutual labels:  cookie
Jeff
🍍Jeff provides the simplest way to manage web sessions in Go.
Stars: ✭ 223 (+189.61%)
Mutual labels:  cookie
Rack Policy
Rack middleware for the EU ePrivacy Directive compliance in Ruby Web Apps
Stars: ✭ 149 (+93.51%)
Mutual labels:  cookie
Vue Warehouse
A Cross-browser storage for Vue.js and Nuxt.js, with plugins support and easy extensibility based on Store.js.
Stars: ✭ 161 (+109.09%)
Mutual labels:  cookie
Brownies
🍫 Tastier cookies, local, session, and db storage in a tiny package. Includes subscribe() events for changes.
Stars: ✭ 2,386 (+2998.7%)
Mutual labels:  cookie
Electrode Csrf Jwt
Stateless Cross-Site Request Forgery (CSRF) protection with JWT
Stars: ✭ 127 (+64.94%)
Mutual labels:  cookie
Cookie-Clicker-Source-Code
Cookie Clicker source code for... educational purposes...
Stars: ✭ 74 (-3.9%)
Mutual labels:  cookie
Cookiescanner
Cookie Scanner for GDPR compliance
Stars: ✭ 126 (+63.64%)
Mutual labels:  cookie
Google Group Crawler
Get (almost) original messages from google group archives. Your data is yours.
Stars: ✭ 190 (+146.75%)
Mutual labels:  cookie
CSRF-tutorial
Use Django To Introduce CSRF and Cookies , Session 📝
Stars: ✭ 49 (-36.36%)
Mutual labels:  cookie
lightcookie
Node cookie parsing and serialization
Stars: ✭ 22 (-71.43%)
Mutual labels:  cookie
All In One Customized Adblock List
An all-in-one adblock list that thoroughly blocks trackers, popup ads, ads, unwanted cookies, fake news, cookie warning messages, typosquatters, unwanted comment sections, crypto-coin mining, YouTube clutter, Twitter guff and social network hassles.
Stars: ✭ 217 (+181.82%)
Mutual labels:  cookie

Scrape Learning (ctrip)

使用时先跑'gen_ticket.py'生成ctrip_ticket,再跑'main.py'
破解eleven参数后,可以不需要调用selenium便可请求到详细的价格信息,提升获取速度、减少资源占用
该爬虫可爬取:

  • 每个酒店名称、评分
  • 每个酒店不同预订时间每种房型价格
  • 每个酒店不同预订时间每种房型满意度
  • 每个酒店不同预订时间每种房型剩余可订数

1. 获得房间价格的重要参数"eleven"的生成方法

  • "eleven"由一个混淆js文件-"oceanball"生成,该文件具有随机性
  • 生成方法:ctrip_funcs.py中的"get_oceanball"、"get_eleven"两个函数,需要配合js代码和python共同生成

2. 发现获得剩余可订房间仅需要Cookie: ctrip_ticket

  • 这个cookie疑似使用“Http-only”Flag 发送,无法直接读取,只能通过浏览器获得。(reference)
  • 该cookie时效较长,可以用selenium每30分钟提取一次
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].