All Projects → iamtodor → angel.co-companies-list-scraping

iamtodor / angel.co-companies-list-scraping

Licence: other
No description or website provided.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to angel.co-companies-list-scraping

Scrapysharp
reborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (+318.52%)
Mutual labels:  scraper, parsing, scraping
Goose Parser
Universal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+290.74%)
Mutual labels:  scraper, parsing, scraping
google-scraper
This class can retrieve search results from Google.
Stars: ✭ 33 (-38.89%)
Mutual labels:  scraper, scraping
Pahe.ph-Scraper
Pahe.ph [Pahe.in] Movies Website Scraper
Stars: ✭ 57 (+5.56%)
Mutual labels:  scraper, scraping
scrapers
scrapers for building your own image databases
Stars: ✭ 46 (-14.81%)
Mutual labels:  scraper, scraping
Colly
Elegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+28668.52%)
Mutual labels:  scraper, scraping
Scrape Linkedin Selenium
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+342.59%)
Mutual labels:  scraper, scraping
gochanges
**[ARCHIVED]** website changes tracker 🔍
Stars: ✭ 12 (-77.78%)
Mutual labels:  scraper, scraping
Anime Dl
Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: ✭ 190 (+251.85%)
Mutual labels:  scraper, scraping
scrapman
Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs
Stars: ✭ 21 (-61.11%)
Mutual labels:  scraper, scraping
extract-emails
Extract emails from a given website
Stars: ✭ 58 (+7.41%)
Mutual labels:  scraper, parsing
copycat
A PHP Scraping Class
Stars: ✭ 70 (+29.63%)
Mutual labels:  scraper, scraping
Instagram-to-discord
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
Stars: ✭ 113 (+109.26%)
Mutual labels:  scraper, scraping
yellowpages-scraper
Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (+3.7%)
Mutual labels:  scraper, parsing
Jsonframe Cheerio
simple multi-level scraper json input/output for Cheerio
Stars: ✭ 196 (+262.96%)
Mutual labels:  scraper, scraping
crawler-chrome-extensions
爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
Stars: ✭ 53 (-1.85%)
Mutual labels:  scraper, scraping
Serpscrap
SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (+183.33%)
Mutual labels:  scraper, scraping
Linkedin Profile Scraper
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+216.67%)
Mutual labels:  scraper, scraping
diffbot-php-client
[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
Stars: ✭ 53 (-1.85%)
Mutual labels:  scraper, scraping
ha-multiscrape
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.
Stars: ✭ 103 (+90.74%)
Mutual labels:  scraper, scraping

angel.co companies list scraping

Unfortunately official provided API by angel.co was shut down.

This script allows you parse the list of the companies provided by angel.co from the page All Companies and save it to all_companies.csv file. Personally, I was interested only in a few columns such as 'name','desc','website','location','employees','raised','angel_url','angel_id' however it wouldn't be hard to add or remove desirable columns.

How to install & run the project

  1. Install python 3.5 or higher
  2. Clone the repo: git clone [email protected]:iamtodor/angel.co-companies-list-scraping.git
  3. Enter into the project: cd angel.co-companies-list-scraping
  4. Install all required libraries: pip3 install -r pip-requirements.txt
  5. Run the command: python3 parse.py. Also, you can run specific script with the specific query: python3 parse.py -q='desired query'. For example, the following command: python3 parse.py -q='computer vision' will parse companies from https://angel.co/companies?keywords=computer+vision page.

Also, I encourage to take a look at this sites, that I found pretty useful for small piece of data:

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].