414 Open source projects that are alternatives of or similar to TripAdvisor-Crawling-Suite

👾 Fast and simple video download library and CLI tool written in Go

Creates an XML-Sitemap by crawling a given site.

simple jquery Plugin that utilizes Google API to get data from a Place on Google Maps

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

[AAAI2021] Unsupervised Opinion Summarization with Content Planning

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS 🎭

A simple and flexible web crawler framework for java.

A Tumblr Backup Application

💯 Get a notification in Slack every time someone asks you to check some code on Github or Bitbucket.

基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

A GitHub Action to send Slack/Teams notification for Pull Request that are waiting for reviewers.

Dynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具

Continuous scalable web crawler built on top of Flink and crawler-commons

A Swift Web Crawler 🕷

🌐 linkedresearch.org

dynamic crawler for web vulnerability scanner

Google search results crawler, get google search results that you need - php

Web crawler.

Using scrapy to scrape tripadvisor in order to get users' reviews.

Official Algolia Plugin for Netlify. Index your website to Algolia when deploying your project to Netlify with the Algolia Crawler

练习NLP，分析淘宝评论的项目

Simple news aggregator displaying top stories in real time

Be nice on the web

直接通过链家 API 抓取数据的极速爬虫，宇宙最快~~ 🚀

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

SSE 50 index options crawler 上证50期权数据爬虫

码云仓库链接:AJay13/ECommerceCrawlers Github 仓库链接:DropsDevopsOrg/ECommerceCrawlers 项目展示平台链接:http://wechat.doonsec.com

Teknolojiyle iç içe olan profesyonellerin çalışma ortamları burada! - https://calismamasam.com

本仓库收集整理爬虫相关资源，开发语言以Java为主

Practical pinned gist which show your latest medium status 📌

A Laravel wrapper for CrawlerDetect - the web crawler detection library

Magento integration for Google Customer Reviews

Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites

Auto Crawler Ptt Beauty Image Use Python Schedule

crawler framework, distributed crawler extractor

A curated collection of annotated code examples from prominent open-source projects

Python Lambda Chrome Automation (naming pending)

PTT 網路版爬蟲

京东口罩库存监控爬虫(非selenium)，扫码登录、查价、加购、下单、秒杀

Scrape Tripadvisor restaurant, hotels, and places.

Gorecon is a All in one Reconnaissance Tool , a.k.a swiss knife for Reconnaissance , A tool that every pentester/bughunter might wanna consider into their arsenal

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

Universal scrapping tool, which allows you to extract data using multiple environments

An application for rapid, structured reviews of outbreak-related preprints

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

We will try to find your visible basic footprint from social media as much as possible - 😤 more sites is comming soon

Elegant Scraper and Crawler Framework for Golang

A Powerful Spider(Web Crawler) System in Python.

JavaScript + BeautifulSoup = JSSoup

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Google search results crawler, get google search results that you need

🤖 Prerendering for JavaScript powered websites. Great solution for PWAs (Progressive Web Apps), SPAs (Single Page Applications), and other websites based on top of front-end JavaScript frameworks

A Python DNS crawler to find identical domain names under different TLDs.

High performance crawler for Nodejs

🌈Python3网络爬虫实战：QQ音乐歌曲、京东商品信息、房天下、破解有道翻译、构建代理池、豆瓣读书、百度图片、破解网易登录、B站模拟扫码登录、小鹅通、荔枝微课

免登录下载微博图片 爬虫 Download Weibo Images without Logging-in