All Projects → rocktimsaikia → meta-fetcher

rocktimsaikia / meta-fetcher

Licence: other
Simple metadata scrapper for node.js

Programming Languages

typescript
32286 projects
javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to meta-fetcher

waifu-generator
Let's pick up your favorite waifu just from the API
Stars: ✭ 31 (-77.37%)
Mutual labels:  scrapper
DECAF
DECAF: Deep Extreme Classification with Label Features
Stars: ✭ 46 (-66.42%)
Mutual labels:  meta-data
Spider
💫 Spider is a PHP library with easily module integration for crawling website that allows you to scrape informations.
Stars: ✭ 14 (-89.78%)
Mutual labels:  scrapper
stweet
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Stars: ✭ 287 (+109.49%)
Mutual labels:  scrapper
shopee-inventory-bot
"I Make dropshiper's job easier" ~ Python Shopee Inventory Bot
Stars: ✭ 21 (-84.67%)
Mutual labels:  scrapper
fiction-dl
A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.
Stars: ✭ 22 (-83.94%)
Mutual labels:  scrapper
jseval
Evaluate JavaScript on a URL through headless Chrome browser.
Stars: ✭ 19 (-86.13%)
Mutual labels:  scrapper
APSoft-Web-Scanner-v2
Powerful dork searcher and vulnerability scanner for windows platform
Stars: ✭ 96 (-29.93%)
Mutual labels:  scrapper
MyTelegramOrgRoBot
telegram.dog/usetgxbot
Stars: ✭ 94 (-31.39%)
Mutual labels:  scrapper
4chanMarkovText
Text Generation using Markov Chains fed by 4chan APIs
Stars: ✭ 28 (-79.56%)
Mutual labels:  scrapper
storexplore
Transform online stores into APIs !
Stars: ✭ 20 (-85.4%)
Mutual labels:  scrapper
xvideos
xvideos API library
Stars: ✭ 165 (+20.44%)
Mutual labels:  scrapper
SigTools
📆 Sigarra Tools | An extension that makes the information system of the University of Porto slightly better.
Stars: ✭ 35 (-74.45%)
Mutual labels:  scrapper
Instagram-to-discord
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
Stars: ✭ 113 (-17.52%)
Mutual labels:  scrapper
gosquito
gosquito ("go" + "mosquito") is a pluggable tool for data gathering, data processing and data transmitting to various destinations.
Stars: ✭ 25 (-81.75%)
Mutual labels:  scrapper
fatec-api
API for SIGA from Centro Paula Souza made for students to create things based in their profile data
Stars: ✭ 47 (-65.69%)
Mutual labels:  scrapper
laravel-block-bots
Block crawlers and high traffic users on your site by IP using Redis
Stars: ✭ 25 (-81.75%)
Mutual labels:  scrapper
MetadataRemover
Android App to remove images' metadata
Stars: ✭ 42 (-69.34%)
Mutual labels:  metadata-extractor

meta-fetcher

GitHub Workflow Status (branch) npm

Simple metadata scrapper for node.js. Under the hood it uses isomorphic-unfetch
to fetch the metadata, parses it and returns it as json object.


Installation

npm install meta-fetcher

or use yarn

yarn add meta-fetcher

Usage

import metaFetcher from 'meta-fetcher';

(async () => {
  const result = await metaFetcher('https://hoppscotch.io/');
  console.log(result);

  /*
        {
            metadata: {
                website: 'https://hoppscotch.io/',
                title: 'Hoppscotch - Open source API development ecosystem',
                description: 'Helps you create requests faster, saving precious time on development.',
                banner: 'https://hoppscotch.io/banner.jpg',
                themeColor: '#202124'
            },
            socials: {
                'twitter:site': '@hoppscotch_io',
                'twitter:creator': '@hoppscotch_io'
            },
            favicons: [
                'https://hoppscotch.io/_nuxt/icons/icon_64x64.9834b3.png',
                'https://hoppscotch.io/_nuxt/icons/icon_512x512.9834b3.png'
            ]
        }
    */
})();

API

metaFetcher(input)

Takes one url string as a parameter and returns an object containing the meta-information.

input

type: string
default: 'none'

The url string to be scrapped.


Related

Here are some related projects

  • page-scrapper: 📦 node.js scrapper that pulls out all links and images of a given site.

License

MIT

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].