GREP FOR OSINT is a set of very simple shell scripts that will help you quickly analyze a text or a folder with files for data useful for investigation (phone numbers, bank card numbers, URLs, emails and nicknames).
You can try this repository directly in your browser (with Gitpod Workspace Snapshot)
https://gitpod.io#snapshot/dd17f163-aa47-4ccd-bbf7-110640cdfc09
or simply download the repository to your computer
Simply replace the text in the "text_for_analyze.txt" file with your text and run one of the .sh files whose name ends in "from_text".
For example:
bash Email_from_text.sh
Or replace the files in the "files_for_analyze" folder with your own and run one of the .sh files ending in "from_folder".
The result will be saved in a new text file with an appropriate name (for example, result_email_from_text_2021.08.01-16.47.52).
In files tags_content_from_folder.sh, tags_content_from_html.sh, Keyword_from_folder.sh, Keyword_from_text.sh you don't have to change anything. You can just run them and enter the desired values directly into the command line after a prompt from the script.
Warning
With large amounts of text the grep command can take a very, very long time.
It's possible to use this tool for analyze html files from WayBack Machine (web.archive.org):
Make sure you have Python installed on your computer or install it.
Next launch
pip install waybackpack
Get list of website's saved pages:
waybackpack http://litsey623.ru/ --list
Download pages version, saved during period between 2010-2011
waybackpack http://litsey623.ru/ -d files_for_analyze --from-date 2010 --to-date 2011
For extracting emails from saved pages launch:
bash Email_from_folder.sh
View file:
result_email_from_folder_(current_date).txt
(Analogously, it is possible to extract keywords, phone numbers, URL etc)
Twitter — https://twitter.com/cyb_detective
Telegram — https://t.me/cybdetective
Linkedin — https://www.linkedin.com/groups/1908171/
Revue — https://www.getrevue.co/profile/cyb_detective
Github — https://github.com/cipher387
Discord — every week I post a fresh invite on Twitter. You can find it by searching for "discord from:cyb_detective"