metafetchNodeJS package that fetches a given URL's title, description, images, links etc.
Stars: ✭ 21 (-99.57%)
scrapy facebookerCollection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-99.55%)
arachnodHigh performance crawler for Nodejs
Stars: ✭ 17 (-99.65%)
flink-crawlerContinuous scalable web crawler built on top of Flink and crawler-commons
Stars: ✭ 48 (-99.01%)
scraperNodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
Stars: ✭ 37 (-99.24%)
evineInteractive CLI Web Crawler
Stars: ✭ 140 (-97.11%)
facebook-discussion-tkA collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.
Stars: ✭ 33 (-99.32%)
Ngx Smart ModalModal/Dialog component crafted for Angular
Stars: ✭ 256 (-94.71%)
ARGUSARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
Stars: ✭ 68 (-98.59%)
Weibo terminator workflowUpdate Version of weibo_terminator, This is Workflow Version aim at Get Job Done!
Stars: ✭ 259 (-94.65%)
kasthack.ospГенератор сырых дампов пользователей VK.
Stars: ✭ 15 (-99.69%)
OnefetchGit repository summary on your terminal
Stars: ✭ 3,680 (-23.92%)
RcrawlerAn R web crawler and scraper
Stars: ✭ 274 (-94.34%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (-90.41%)
Starcli✨ Browse GitHub trending projects from your command line
Stars: ✭ 269 (-94.44%)
Rust SlothA 3D software rasterizer... for the terminal!
Stars: ✭ 478 (-90.12%)
TeipSelect partial standard input and replace with the result of another command efficiently
Stars: ✭ 280 (-94.21%)
DoitliveBecause sometimes you need to do it live
Stars: ✭ 3,073 (-36.47%)
PygogoA Python logging library with superpowers
Stars: ✭ 265 (-94.52%)
RexYour RegEx companion.
Stars: ✭ 283 (-94.15%)
Circleci CliUse CircleCI from the command line
Stars: ✭ 297 (-93.86%)
Hquery.phpAn extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
Stars: ✭ 295 (-93.9%)
BubblesTUI components for Bubble Tea 🍡
Stars: ✭ 467 (-90.35%)
To langTranslate Ruby strings and arrays with Google Translate.
Stars: ✭ 303 (-93.74%)
MotioniaMotionia is a lightweight simplified on demand animation library!
Stars: ✭ 294 (-93.92%)
CryptocmdCryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.
Stars: ✭ 299 (-93.82%)
Frankenstein Correct README Redirects
Stars: ✭ 305 (-93.69%)
Rawkit🦊 Immediately Open Chrome DevTools when debugging Node.js apps
Stars: ✭ 306 (-93.67%)
LinkedinLinkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
Stars: ✭ 309 (-93.61%)
Whatspup🔳 WhatsApp chat from commandline/console/cli using GoogleChrome puppeteer
Stars: ✭ 310 (-93.59%)
Fastify CliRun a Fastify application with one command!
Stars: ✭ 260 (-94.62%)
Diff2html CliPretty diff to html javascript cli (diff2html-cli)
Stars: ✭ 287 (-94.07%)
SinglefileWeb Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file
Stars: ✭ 4,417 (-8.68%)
PastelA command-line tool to generate, analyze, convert and manipulate colors
Stars: ✭ 3,742 (-22.64%)
KiimagepagerThe KIImagePager is inspired by foursquare's ImageSlideshow, the user may scroll through images loaded from the Web
Stars: ✭ 324 (-93.3%)
GraphbackGraphback - Out of the box GraphQL server and client
Stars: ✭ 323 (-93.32%)
TeachcodeA tool to develop and improve a student’s programming skills by introducing the earliest lessons of coding.
Stars: ✭ 325 (-93.28%)
FdA simple, fast and user-friendly alternative to 'find'
Stars: ✭ 19,851 (+310.4%)
HorusecHorusec is an open source tool that improves identification of vulnerabilities in your project with just one command.
Stars: ✭ 311 (-93.57%)
LaunchpadAn open-source game launcher for your games
Stars: ✭ 322 (-93.34%)
Ack3ack is a grep-like search tool optimized for source code.
Stars: ✭ 330 (-93.18%)
Xcrawler快速、简洁且强大的PHP爬虫框架
Stars: ✭ 344 (-92.89%)
XidelCommand line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Stars: ✭ 335 (-93.07%)
Super ProductivityTo-do list & time tracker for programmers and other digital workers with Jira, Github, and Gitlab integration
Stars: ✭ 4,505 (-6.86%)
Ghost CliCLI Tool for installing & updating Ghost
Stars: ✭ 313 (-93.53%)
AskqlAskQL is a query language that can express any data request
Stars: ✭ 352 (-92.72%)
Freshonions TorscraperFresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (-92.81%)
KatanaA Python Tool For google Hacking
Stars: ✭ 355 (-92.66%)
Undetected ChromedriverCustom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Stars: ✭ 365 (-92.45%)
JqlA JSON Query Language CLI tool
Stars: ✭ 368 (-92.39%)
Anglesharp👼 The ultimate angle brackets parser library parsing HTML5, MathML, SVG and CSS to construct a DOM based on the official W3C specifications.
Stars: ✭ 4,018 (-16.93%)
Mongo SeedingThe ultimate solution for populating your MongoDB database.
Stars: ✭ 375 (-92.25%)