All Projects → Coalfire-Research → Git-Scrapers

Coalfire-Research / Git-Scrapers

Licence: other
Collect OSINT from git repositories

Programming Languages

ruby
36898 projects - #4 most used programming language

Projects that are alternatives of or similar to Git-Scrapers

username-generation-guide
A definitive guide to generating usernames for OSINT purposes
Stars: ✭ 38 (+153.33%)
Mutual labels:  osint
censys-maltego
Censys Maltego transforms! Take advantage of Censys transforms for Maltego to back your investigations with the most trusted Internet data available.
Stars: ✭ 25 (+66.67%)
Mutual labels:  osint
quick-recon.py
Do some quick reconnaissance on a domain-based web-application
Stars: ✭ 13 (-13.33%)
Mutual labels:  osint
linkedinscraper
LinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.
Stars: ✭ 22 (+46.67%)
Mutual labels:  osint
aquatone
A Tool for Domain Flyovers
Stars: ✭ 43 (+186.67%)
Mutual labels:  osint
Resources
No description or website provided.
Stars: ✭ 38 (+153.33%)
Mutual labels:  osint
bing-ip2hosts
bingip2hosts is a Bing.com web scraper that discovers websites by IP address
Stars: ✭ 99 (+560%)
Mutual labels:  osint
tenssens
Tenssens framework focused on gathering information from free tools or resources. The intention is to help people find free OSINT resources.
Stars: ✭ 19 (+26.67%)
Mutual labels:  osint
SingleFile-Lite
Feel the power of the Manifest V3. The future, right now!
Stars: ✭ 55 (+266.67%)
Mutual labels:  osint
misp-osint-collection
Collection of best practices to add OSINT into MISP and/or MISP communities
Stars: ✭ 54 (+260%)
Mutual labels:  osint
linky
Yet Another LInkedIn Scraper...
Stars: ✭ 44 (+193.33%)
Mutual labels:  osint
DaProfiler
DaProfiler allows you to create a profile on your target based in France only. The particularity of this program is its ability to find the e-mail addresses your target.
Stars: ✭ 58 (+286.67%)
Mutual labels:  osint
hashnode-browser-extensions
Google chrome & Mozilla firefox browser extensions for Hashnode
Stars: ✭ 20 (+33.33%)
Mutual labels:  developers
gitformant
OSINT tool for discovering confidential data leaked on Github.
Stars: ✭ 34 (+126.67%)
Mutual labels:  osint
iocingestor
An extendable tool to extract and aggregate IoCs from threat feeds
Stars: ✭ 25 (+66.67%)
Mutual labels:  osint
FisherMan
CLI program that collects information from facebook user profiles via Selenium.
Stars: ✭ 117 (+680%)
Mutual labels:  osint
OSINT-TOOLS-CLI
THIS IS A CLI VERSION OF THE CHEAT SHEET FOR EASY ACCESS. IT CAN BE NAVIGATED WITHOUT USING COMMANDS.
Stars: ✭ 32 (+113.33%)
Mutual labels:  osint
grep for osint
GREP FOR OSINT is a set of very simple shell scripts that will help you quickly analyze a text or a folder with files for data useful for investigation (phone numbers, bank card numbers, URLs, emails and nicknames).
Stars: ✭ 21 (+40%)
Mutual labels:  osint
awesome-developers
A list of awesome developers
Stars: ✭ 60 (+300%)
Mutual labels:  developers
occli
Unofficial Command Line Interface for OpenCorporates
Stars: ✭ 18 (+20%)
Mutual labels:  osint

git-user.rb

Patrick Hurd, Coalfire Federal


OSINT tool specifically for targetting developers.

What you get:

  • Profile information
  • Commit authorship information
  • See options list for non-default output

Setup

  1. sudo apt install ruby
  2. sudo gem install httparty
  3. sudo apt install aha (Required for mine output)
  4. sudo apt install whois (Required for whois output)
  5. Add your GitHub username/password/token to your gitconfig if you plan on mining private repos

Usage:

Usage: git-user.rb [options]
    -h, --help                       Show this help banner

    -u, --user USERNAME              User to gather info from
    -o, --organization ORGANIZATION  Organization to scrape
    -r, --repo REPO                  The repo whom's contributors to scrape
        --local ABSOLUTE_PATH        Perform scrape on a repo local to your filesystem
        --name NAME                  Name to refer to a --local repo in report filenames

    -a, --auth                       Authenticate with HTTP basic auth
    -t, --token TOKEN                Use specified GitHub personal access token

    -s, --stackoverflow              Try to find users' accounts on StackOverflow
    -p, --pwned                      Search for relevant data breaches using haveibeenpwned
    -e, --extra_checking             Do extra checking on email addresses
    -m, --mine                       Mine the repo or user/organization's repos for secrets
        --whois                      Perform whois lookup on domains found in profile information
    -l, --loud                       Perform active recon on users (scrape their personal site)

        --html                       Output main report to an HTML document
    -w, --wordlist                   Generate wordlist for use in password attacks
    -c, --csv                        Export discovered accounts to a GoPhish-importable CSV file

Add the following line to your .bashrc or .zshrc if you're using zsh to enable argument autocompletion (optional):

complete -W "--help --user --organization --repo --auth --token --stackoverflow --pwned --extra_checking --mine --html --wordlist --whois --loud --csv --local --name" git-user.rb

Example command:

./git-user.rb -t deadb33f... -o Coalfire-Research -r Git-Scrapers -s -p -e -m --html -c

If you have two-factor authentication enabled on your GitHub account, you will need to create and use an application token instead of your password (using -t TOKEN instead of -a).

Repo mining will skip forked repos.

How you can help:

Check out the issues

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].