twintproject / Twint Search
Licence: mit
Explore tweets gathered with Twint with faceted search
Stars: ✭ 42
Programming Languages
javascript
184084 projects - #8 most used programming language
Projects that are alternatives of or similar to Twint Search
Twint
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
Stars: ✭ 12,102 (+28714.29%)
Mutual labels: osint, elasticsearch, tweets
Docker Magento Mutagen
Mage2click Docker-based development environment for Magento with mutagen.io sync for files on macOS
Stars: ✭ 64 (+52.38%)
Mutual labels: elasticsearch, docker-compose
Docker offensive elk
Elasticsearch for Offensive Security
Stars: ✭ 112 (+166.67%)
Mutual labels: elasticsearch, docker-compose
Docker Elk
The Elastic stack (ELK) powered by Docker and Compose.
Stars: ✭ 12,327 (+29250%)
Mutual labels: elasticsearch, docker-compose
Spring Boot Microservice Eureka Zuul Docker
Spring-Boot rest microservices using Eureka, Zuul, Docker. Monitoring with logstash, logback, elasticsearch, kibana
Stars: ✭ 45 (+7.14%)
Mutual labels: elasticsearch, docker-compose
Microservices Sample
Sample project to create an application using microservices architecture
Stars: ✭ 167 (+297.62%)
Mutual labels: elasticsearch, docker-compose
Elastic Docker
Example setups for Elasticsearch, Kibana, Logstash, and Beats with docker-compose
Stars: ✭ 118 (+180.95%)
Mutual labels: elasticsearch, docker-compose
Docker Compose Elasticsearch Kibana
Docker Compose for Elasticsearch and Kibana
Stars: ✭ 584 (+1290.48%)
Mutual labels: elasticsearch, docker-compose
Springy Store Microservices
Springy Store is a conceptual simple μServices-based project using the latest cutting-edge technologies, to demonstrate how the Store services are created to be a cloud-native and 12-factor app agnostic. Those μServices are developed based on Spring Boot & Cloud framework that implements cloud-native intuitive, design patterns, and best practices.
Stars: ✭ 318 (+657.14%)
Mutual labels: elasticsearch, docker-compose
Phpmyfaq
phpMyFAQ - Open Source FAQ web application for PHP and MySQL, PostgreSQL and other databases
Stars: ✭ 494 (+1076.19%)
Mutual labels: elasticsearch, docker-compose
Laravel Docker Elasticsearch
This is a simple repo for practicing elasticsearch with laravel and docker.
Stars: ✭ 18 (-57.14%)
Mutual labels: elasticsearch, docker-compose
Openwisp Monitoring
Network monitoring system written in Python and Django, designed to be extensible, programmable, scalable and easy to use by end users: once the system is configured, monitoring checks, alerts and metric collection happens automatically.
Stars: ✭ 37 (-11.9%)
Mutual labels: elasticsearch
Kuzzle
Open-source Back-end, self-hostable & ready to use - Real-time, storage, advanced search - Web, Apps, Mobile, IoT -
Stars: ✭ 991 (+2259.52%)
Mutual labels: elasticsearch
Antvueblogfront
🔥使用Vue全家桶 + Egg + Mongodb 写的个人网站博客。使用docker compose 一键部署。(最近比较忙,部署还有点问题,后期补上)
Stars: ✭ 36 (-14.29%)
Mutual labels: docker-compose
Elasticsplunk
A Search command to explore Elasticsearch data within Splunk.
Stars: ✭ 35 (-16.67%)
Mutual labels: elasticsearch
Foundatio.parsers
A lucene style query parser that is extensible and allows modifying the query.
Stars: ✭ 39 (-7.14%)
Mutual labels: elasticsearch
French Sentiment Analysis Dataset
A collection of over 1.5 Million tweets data translated to French, with their sentiment.
Stars: ✭ 35 (-16.67%)
Mutual labels: tweets
Diskover
File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch
Stars: ✭ 977 (+2226.19%)
Mutual labels: elasticsearch
How to use
First use
For fisrt usage, you need to build image docker.
docker-compose build
Quick start
docker network create nw_twint
docker-compose up -d elasticsearch
sleep 10
docker-compose up -d searchapp
docker-compose run twint -u noneprivacy -es elasticsearch:9200 --json -o /opt/twint/noneprivacy.json
open http://localhost:3000
Twint, Elasticsearch & Searchapp
Start to up elaticsearch and searchapp
docker network create nw_twint
docker-compose up -d elasticsearch searchapp twint
Execute Twint command
docker network create nw_twint
docker-compose run -v $PWD/output:/srv/twint twint {{CMD TWINT}}
Examples of command
A few simple examples to help you understand the basics:
docker-compose run twint -u username -es elasticsearch:9200
docker-compose run twint -s "#osint" -es elasticsearch:9200
docker-compose run twint -u username -es elasticsearch:9200 --json -o /opt/twint/username.json
USERNAME=username docker-compose run twint -u ${USERNAME} -es elasticsearch:9200 --json -o /opt/twint/${USERNAME}.json
if local install of twint
twint -u username -es localhost:9200
twint -u username -es localhost:9200 --json -o /opt/twint/username.json
Search engine
- Allows to do faceted search
- Current build is developpment so you can do change and re-compile in real-time.
open http://localhost:3000
Debug Elasticsearch
open http://localhost:9000
open http://localhost:9200/twinttweets/_search?pretty=true&q=*:*
open http://localhost:9200/twinttweets/_count?pretty
Screenshots
Known Issues ⚠️
I have noticed when running the new 5.0+ version on a linux host you need to increase the memory map areas with the following command
sudo sysctl -w vm.max_map_count=262144
More at https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html
Issues
Find a bug? Want more features? Find something missing in the documentation? Let me know! Please don't hesitate to file an issue
To do
- Embed video in tweets
- Tweet with images
- Tweet with location
- Filter re-tweets
- All the most crazy things possible
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].