Php CrawlerA php crawler that finds emails on the internets
Stars: ✭ 119 (+158.7%)
InstagoDownload/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Stars: ✭ 59 (+28.26%)
Nytimes App🗽 A Simple Demonstration of the New York Times App 📱 using Jsoup web crawler with MVVM Architecture 🔥
Stars: ✭ 246 (+434.78%)
HuginnCreate agents that monitor and act on your behalf. Your agents are standing by!
Stars: ✭ 33,694 (+73147.83%)
keywordsextractkeywords-extract - Command line tool extract keywords from any web page.
Stars: ✭ 50 (+8.7%)
ImghashPerceptual image hashing for Node.js
Stars: ✭ 98 (+113.04%)
ecommercetoolsEcommerceTools is a Python data science toolkit for ecommerce, marketing science, and technical SEO analysis and modelling and was created by Matt Clarke.
Stars: ✭ 41 (-10.87%)
InstascrapePowerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically
Stars: ✭ 202 (+339.13%)
TiktokbotA TikTokBot that downloads trending tiktok videos and compiles them using FFmpeg
Stars: ✭ 126 (+173.91%)
seotoolNew version of my keyword tracking tool with additional features - works currently for google.de!
Stars: ✭ 52 (+13.04%)
SoupWeb Scraper in Go, similar to BeautifulSoup
Stars: ✭ 1,685 (+3563.04%)
SEO-DashboardSEO dashboard from Search console Data using the Google Search API, Mysql database , NodeJS RESTAPI( ExpressJS) and reactJs Dashboard
Stars: ✭ 39 (-15.22%)
WswpCode for the second edition Web Scraping with Python book by Packt Publications
Stars: ✭ 112 (+143.48%)
serp-parserNodejs lib to parse Google SERP html pages
Stars: ✭ 28 (-39.13%)
Clock可视化任务调度系统,精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)
Stars: ✭ 86 (+86.96%)
seo-audits-toolkitSEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ...
Stars: ✭ 311 (+576.09%)
Fifa Fut DataWeb-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB
Stars: ✭ 55 (+19.57%)
ConfigsPublic, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores
Stars: ✭ 37 (-19.57%)
sitemap-checkera tool for validate xml sitemap and sitemap index files for broken links
Stars: ✭ 21 (-54.35%)
Hq bot📲 Bot to help solve HQ trivia
Stars: ✭ 167 (+263.04%)
StardoxGithub stargazers information gathering tool
Stars: ✭ 130 (+182.61%)
Gazpacho🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+1041.3%)
xsitemapAn R' 📦 to deal with XML sitemaps and help SEO
Stars: ✭ 15 (-67.39%)
Ralgerralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.
Stars: ✭ 130 (+182.61%)
SeotoolsSEO Tools for Laravel
Stars: ✭ 2,406 (+5130.43%)
Anirip🎬 A Crunchyroll show/season ripper
Stars: ✭ 127 (+176.09%)
DNZ.SEOCheckerSEO Checker and Recommander Plugin (like wordpress Yoast) for ASP.NET Core.
Stars: ✭ 18 (-60.87%)
aws-pdf-textract-pipeline🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Stars: ✭ 141 (+206.52%)
NytcrosswordAn exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.
Stars: ✭ 117 (+154.35%)
SetheumSetheum Network - Islamic Finance DeFi, Multi-Stablecoins, Payments, EVM, DeFi on Rockets to Heaven => 🚀ready for hacking🚀
Stars: ✭ 15 (-67.39%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (+117.39%)
Google-rank-trackerSEO: Python script + shell script and cronjob to check ranks on a daily basis
Stars: ✭ 124 (+169.57%)
Udemy botAn automation bot for free Udemy courses
Stars: ✭ 91 (+97.83%)
PoliteBe nice on the web
Stars: ✭ 253 (+450%)
Covid 19 jhu data web scrap and cleaningThis repository contains data and code used to get and clean data from https://github.com/CSSEGISandData/COVID-19 and https://www.worldometers.info/coronavirus/
Stars: ✭ 80 (+73.91%)
GoodReadsScraper📚 A GoodReads.com Scraper script to get books reviews including text and rating.
Stars: ✭ 36 (-21.74%)
CrosslinkedLinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
Stars: ✭ 223 (+384.78%)
Sneakerbot AppApp that scrapes the Footlocker website to construct URLs for upcoming sneaker releases and adds the shoe to your cart if it is available. Uses Python and Selenium Webdriver. *Chrome and Chromedriver must be installed and Chromedriver must be on main path
Stars: ✭ 54 (+17.39%)
Tradingview Data ScraperExtract price and indicator data from TradingView charts to create ML datasets
Stars: ✭ 203 (+341.3%)
RedditsfinderArchive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushshift API.
Stars: ✭ 28 (-39.13%)
SeoTagsSeoTags create all SEO tags you need such as meta, link, twitter card (twitter:), open graph (og:), and JSON-LD schema (structred data).
Stars: ✭ 113 (+145.65%)
Sig To GooglecalendarA python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar
Stars: ✭ 14 (-69.57%)
FalkorOpen Source web scraping API. Falkor turns web pages into queryable JSON
Stars: ✭ 184 (+300%)
DatadoubleconfirmSimple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.
Stars: ✭ 24 (-47.83%)
people-also-askPeople also ask Google scraper. Get as many questions as you need to optimize your site for voice or new content ideas or answering questions about your desired topic.
Stars: ✭ 39 (-15.22%)
DecryptrAn extensible API for breaking captchas
Stars: ✭ 154 (+234.78%)
mirror-mirrorA library to get images from social media
Stars: ✭ 15 (-67.39%)
NordVPN-switcherRotate between different NordVPN servers with ease. Works both on Linux and Windows without any required changes to your code!
Stars: ✭ 143 (+210.87%)
Meta TagsSearch Engine Optimization (SEO) for Ruby on Rails applications.
Stars: ✭ 2,464 (+5256.52%)
pokeA simple tool to check your site for broken links, media, iframes, stylesheets, scripts, forms or metadata.
Stars: ✭ 24 (-47.83%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+213.04%)