All Projects → d-Rickyy-b → Pastepwn

d-Rickyy-b / Pastepwn

Licence: mit
Python framework to scrape Pastebin pastes and analyze them

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Pastepwn

Scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Stars: ✭ 42,343 (+48570.11%)
Mutual labels:  hacktoberfest, scraping, framework
Platform
A modular multilingual CMS built with Laravel 5.
Stars: ✭ 719 (+726.44%)
Mutual labels:  hacktoberfest, framework
Dataengineeringproject
Example end to end data engineering project.
Stars: ✭ 82 (-5.75%)
Mutual labels:  hacktoberfest, scraping
Sylius
Open Source eCommerce Platform on Symfony
Stars: ✭ 6,598 (+7483.91%)
Mutual labels:  hacktoberfest, framework
Reconspider
🔎 Most Advanced Open Source Intelligence (OSINT) Framework for scanning IP Address, Emails, Websites, Organizations.
Stars: ✭ 621 (+613.79%)
Mutual labels:  osint, framework
Parsel
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
Stars: ✭ 628 (+621.84%)
Mutual labels:  hacktoberfest, scraping
Reactiveui
An advanced, composable, functional reactive model-view-viewmodel framework for all .NET platforms that is inspired by functional reactive programming. ReactiveUI allows you to abstract mutable state away from your user interfaces, express the idea around a feature in one readable place and improve the testability of your application.
Stars: ✭ 6,709 (+7611.49%)
Mutual labels:  hacktoberfest, framework
Mvikotlin
Extendable MVI framework for Kotlin Multiplatform with powerful debugging tools (logging and time travel)
Stars: ✭ 483 (+455.17%)
Mutual labels:  hacktoberfest, framework
Nekobin
Elegant and open-source pastebin service
Stars: ✭ 61 (-29.89%)
Mutual labels:  hacktoberfest, pastebin
Backtesting.py
🔎 📈 🐍 💰 Backtest trading strategies in Python.
Stars: ✭ 1,124 (+1191.95%)
Mutual labels:  hacktoberfest, framework
Falcon
The no-nonsense REST API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.
Stars: ✭ 8,654 (+9847.13%)
Mutual labels:  hacktoberfest, framework
Gazpacho
🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+503.45%)
Mutual labels:  hacktoberfest, scraping
Operative Framework
operative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
Stars: ✭ 511 (+487.36%)
Mutual labels:  osint, framework
Symfony
The Symfony PHP framework
Stars: ✭ 26,220 (+30037.93%)
Mutual labels:  hacktoberfest, framework
Facebook Scraper
Scrape Facebook public pages without an API key
Stars: ✭ 499 (+473.56%)
Mutual labels:  hacktoberfest, scraping
Juice
The Hacker's Machine Learning Engine
Stars: ✭ 743 (+754.02%)
Mutual labels:  hacktoberfest, framework
Loadingshimmer
An easy way to add a shimmering effect to any view with just one line of code. It is useful as an unobtrusive loading indicator.
Stars: ✭ 1,180 (+1256.32%)
Mutual labels:  hacktoberfest, framework
Polaris
A cross-platform, minimalist web framework for PowerShell
Stars: ✭ 464 (+433.33%)
Mutual labels:  hacktoberfest, framework
Ferret
Declarative web scraping
Stars: ✭ 4,837 (+5459.77%)
Mutual labels:  hacktoberfest, scraping
Dragon
⚡A powerful HTTP router and URL matcher for building Deno web servers.
Stars: ✭ 56 (-35.63%)
Mutual labels:  hacktoberfest, framework

Logo

pastepwn - Paste-Scraping Python Framework

Build Status PyPI version Coverage Status Codacy Badge

Pastebin is a very helpful tool to store or rather share ascii encoded data online. In the world of OSINT, pastebin is being used by researchers all around the world to retreive e.g. leaked account data, in order to find indicators about security breaches.

Pastepwn is a framework to scrape pastes and scan them for certain indicators. There are several analyzers and actions to be used out-of-the-box, but it is also easily extensible - you can create your own analyzers and actions on the fly.

Please note: This framework is not to be used for illegal actions. It can be used for querying public Pastebin pastes for e.g. your username or email address in order to increase your own security.

⚠️ Important note

In April 2020 Pastebin disabled access to their scraping API for a short period of time. At first people weren't able to access the scraping API in any way, but later on they re-enabled access to the API setup page. But since then it isn't possible to scrape "text" pastes. Only pastes with any kind of syntax set. That reduces the amount of pastes to a minimum, which reduced the usefulness of this tool.

Setting up pastepwn

To use the pastepwn framework you need to follow these simple steps:

  1. Make sure to have a Pastebin premium account!
  2. Install pastepwn via pip (pip3 install pastepwn
  3. Create a file (e.g. main.py) in your project root, where you put your code in²
  4. Fill that file with content - add analyzers and actions. Check the example implementation.

¹ Note that pastepwn only works with python3.5 or above (so better use pip3)
² (If you want to store all pastes, make sure to setup a mongodb, mysql or sqlite instance)

Behind a proxy

There are 2 ways to use this tool behind a proxy:

  • Define the following environment variables: HTTP_PROXY, HTTPS_PROXY, NO_PROXY.
  • When initializing the PastePwn object, use the proxies argument. proxies is a dict as defined in requests' documentation.

Troubleshooting

If you are having troubles, check out the wiki pages first. If your question/issue is not resolved there, feel free to create an issue or contact me on Telegram.

Roadmap and ToDos

Check the bug tracker on GitHub to get an up-to-date status about features and ToDos.

  • REST API for querying paste data (will be another project)
  • Add a helpful wiki with instructions and examples
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].