SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (+393.55%)
Crow TranslateA simple and lightweight translator that allows to translate and speak text using Google, Yandex and Bing.
Stars: ✭ 503 (+1522.58%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-35.48%)
SerpGoogle Search SERP Scraper
Stars: ✭ 40 (+29.03%)
Translators🌏🌍🌎Translators🌎🌍🌏 is a library which aims to bring free, multiple, enjoyable translation to individuals and students in Python. Translators是一个旨在用Python为个人和学生带来免费、多样、愉快翻译的库。
Stars: ✭ 295 (+851.61%)
bing-ip2hostsbingip2hosts is a Bing.com web scraper that discovers websites by IP address
Stars: ✭ 99 (+219.35%)
site-audit-seoWeb service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.
Stars: ✭ 91 (+193.55%)
Image searchPython Library to download images and metadata from popular search engines.
Stars: ✭ 86 (+177.42%)
SitedorksSearch Google/Bing/Ecosia/DuckDuckGo/Yandex/Yahoo for a search term with a default set of websites, bug bounty programs or a custom collection.
Stars: ✭ 221 (+612.9%)
drupal 8 unset html head link🤖 Module for unset any wrong HTML links (like rel="delete-form", rel="edit-form", etc.) from head on Drupal 8.x websites. This is trust way to grow up position in SERP Google, Yandex, etc.
Stars: ✭ 19 (-38.71%)
awesome-search-engine-optimizationA curated list of backlink, social signal opportunities, and link building strategies and tactics to help improve search engine results and ranking.
Stars: ✭ 82 (+164.52%)
safe-searchSets the built-in adult content filter (most often: safe search) on Google, YouTube, Bing, Yahoo, DuckDuckGo, Startpage, Dogpile, Yandex, Vimeo, Reddit, Ecosia, Dailymotion, Qwant, and Patreon.
Stars: ✭ 16 (-48.39%)
berlin corona casesScraper for the official dashboard with current Corona case numbers, traffic light indicators ("Corona-Ampel") and vaccination situation for Berlin.
Stars: ✭ 19 (-38.71%)
ttc subway timesA scraper to grab and publish TTC subway arrival times.
Stars: ✭ 40 (+29.03%)
sitemapA simple sitemap generator for Laravel Framework.
Stars: ✭ 32 (+3.23%)
Website-AuditIt's an open-source report template that guides web professionals thought steps to audit any website in terms of the page speed and technical SEO optimisation.
Stars: ✭ 18 (-41.94%)
RPICovidScraperscraper for Rensselaer Polytechnic Institute (RPI)'s Covid Dashboard
Stars: ✭ 12 (-61.29%)
TgTranslatorTelegram bot that removes language barrier between people in groups
Stars: ✭ 32 (+3.23%)
ZeiverA Scraper, Downloader, & Recorder for static open directories.
Stars: ✭ 14 (-54.84%)
discord-musicDiscord music bot written in Typescript
Stars: ✭ 12 (-61.29%)
linkyYet Another LInkedIn Scraper...
Stars: ✭ 44 (+41.94%)
scraperNodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
Stars: ✭ 37 (+19.35%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (-22.58%)
spiderMultithreaded Web spider crawler written in Rust.
Stars: ✭ 81 (+161.29%)
extract-cssExtract all CSS from a webpage, packaged as a Now V2 Lambda
Stars: ✭ 23 (-25.81%)
dolarPyChecks USD/PYG exchange rate from several sites, with a calculator, RESTful API and a twitter bot
Stars: ✭ 45 (+45.16%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-51.61%)
html2rss-web🕸 Generates and delivers RSS feeds via HTTP. Create your own feeds or get started quickly with the included configs.
Stars: ✭ 36 (+16.13%)
laravel-seoSEO package for Laravel
Stars: ✭ 136 (+338.71%)
trainline-pythonNon-official Python wrapper and CLI tool for Trainline
Stars: ✭ 41 (+32.26%)
bing-dict.elMinimalists' Bing dictionary for Emacs
Stars: ✭ 48 (+54.84%)
spiderable-middleware🤖 Prerendering for JavaScript powered websites. Great solution for PWAs (Progressive Web Apps), SPAs (Single Page Applications), and other websites based on top of front-end JavaScript frameworks
Stars: ✭ 29 (-6.45%)
Android-Apps-Downloader📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).
Stars: ✭ 16 (-48.39%)
facebook-discussion-tkA collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.
Stars: ✭ 33 (+6.45%)
linkedinscraperLinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.
Stars: ✭ 22 (-29.03%)
quoters📝 Random quotes generator package. Available on npm and PyPi
Stars: ✭ 17 (-45.16%)
ogcheckr-apiAn api to check social media username availability on a variety of services
Stars: ✭ 18 (-41.94%)
sp-subway-scraper🚆This web scraper builds a dataset for São Paulo subway operation status
Stars: ✭ 24 (-22.58%)
seo-by-rank-mathRank Math is a revolutionary WordPress SEO Plugin that combines the features of many SEO tools and lets you multiply your traffic in the easiest way possible 💡 📈 →
Stars: ✭ 54 (+74.19%)
pysoundcloudScraping the Un–scrapable™
Stars: ✭ 63 (+103.23%)
mongodb-scraperScraps for publicly accessible MongoDB instances and dumps user passwords
Stars: ✭ 33 (+6.45%)
scoopi-scraperScoopi Web Scraper is a heavy duty tool to extract data from HTML pages.
Stars: ✭ 18 (-41.94%)
bots-zooNo description or website provided.
Stars: ✭ 59 (+90.32%)
munich-scriptsSome useful scripts simplifying bureaucracy
Stars: ✭ 105 (+238.71%)
botCompletely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
Stars: ✭ 321 (+935.48%)