All Projects → twintproject → Twint Search

twintproject / Twint Search

Licence: mit
Explore tweets gathered with Twint with faceted search

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Twint Search

Twint
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
Stars: ✭ 12,102 (+28714.29%)
Mutual labels:  osint, elasticsearch, tweets
Docker Magento Mutagen
Mage2click Docker-based development environment for Magento with mutagen.io sync for files on macOS
Stars: ✭ 64 (+52.38%)
Mutual labels:  elasticsearch, docker-compose
Docker offensive elk
Elasticsearch for Offensive Security
Stars: ✭ 112 (+166.67%)
Mutual labels:  elasticsearch, docker-compose
Docker Elk
The Elastic stack (ELK) powered by Docker and Compose.
Stars: ✭ 12,327 (+29250%)
Mutual labels:  elasticsearch, docker-compose
Spring Boot Microservice Eureka Zuul Docker
Spring-Boot rest microservices using Eureka, Zuul, Docker. Monitoring with logstash, logback, elasticsearch, kibana
Stars: ✭ 45 (+7.14%)
Mutual labels:  elasticsearch, docker-compose
Microservices Sample
Sample project to create an application using microservices architecture
Stars: ✭ 167 (+297.62%)
Mutual labels:  elasticsearch, docker-compose
Elastic Docker
Example setups for Elasticsearch, Kibana, Logstash, and Beats with docker-compose
Stars: ✭ 118 (+180.95%)
Mutual labels:  elasticsearch, docker-compose
Docker Compose Elasticsearch Kibana
Docker Compose for Elasticsearch and Kibana
Stars: ✭ 584 (+1290.48%)
Mutual labels:  elasticsearch, docker-compose
Springy Store Microservices
Springy Store is a conceptual simple μServices-based project using the latest cutting-edge technologies, to demonstrate how the Store services are created to be a cloud-native and 12-factor app agnostic. Those μServices are developed based on Spring Boot & Cloud framework that implements cloud-native intuitive, design patterns, and best practices.
Stars: ✭ 318 (+657.14%)
Mutual labels:  elasticsearch, docker-compose
Pfelk
pfSense/OPNsense + ELK
Stars: ✭ 417 (+892.86%)
Mutual labels:  elasticsearch, docker-compose
Phpmyfaq
phpMyFAQ - Open Source FAQ web application for PHP and MySQL, PostgreSQL and other databases
Stars: ✭ 494 (+1076.19%)
Mutual labels:  elasticsearch, docker-compose
Laravel Docker Elasticsearch
This is a simple repo for practicing elasticsearch with laravel and docker.
Stars: ✭ 18 (-57.14%)
Mutual labels:  elasticsearch, docker-compose
Openwisp Monitoring
Network monitoring system written in Python and Django, designed to be extensible, programmable, scalable and easy to use by end users: once the system is configured, monitoring checks, alerts and metric collection happens automatically.
Stars: ✭ 37 (-11.9%)
Mutual labels:  elasticsearch
Kuzzle
Open-source Back-end, self-hostable & ready to use - Real-time, storage, advanced search - Web, Apps, Mobile, IoT -
Stars: ✭ 991 (+2259.52%)
Mutual labels:  elasticsearch
Antvueblogfront
🔥使用Vue全家桶 + Egg + Mongodb 写的个人网站博客。使用docker compose 一键部署。(最近比较忙,部署还有点问题,后期补上)
Stars: ✭ 36 (-14.29%)
Mutual labels:  docker-compose
Elasticsplunk
A Search command to explore Elasticsearch data within Splunk.
Stars: ✭ 35 (-16.67%)
Mutual labels:  elasticsearch
Docker Liferay Portal
Stars: ✭ 41 (-2.38%)
Mutual labels:  docker-compose
Foundatio.parsers
A lucene style query parser that is extensible and allows modifying the query.
Stars: ✭ 39 (-7.14%)
Mutual labels:  elasticsearch
French Sentiment Analysis Dataset
A collection of over 1.5 Million tweets data translated to French, with their sentiment.
Stars: ✭ 35 (-16.67%)
Mutual labels:  tweets
Diskover
File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch
Stars: ✭ 977 (+2226.19%)
Mutual labels:  elasticsearch

How to use

First use

For fisrt usage, you need to build image docker.

docker-compose build

Quick start

docker network create nw_twint
docker-compose up -d elasticsearch
sleep 10
docker-compose up -d searchapp
docker-compose run twint -u noneprivacy -es elasticsearch:9200 --json -o /opt/twint/noneprivacy.json
open http://localhost:3000

Twint, Elasticsearch & Searchapp

Start to up elaticsearch and searchapp

docker network create nw_twint
docker-compose up -d elasticsearch searchapp twint

Execute Twint command

docker network create nw_twint
docker-compose run -v $PWD/output:/srv/twint twint {{CMD TWINT}}

Examples of command

A few simple examples to help you understand the basics:

docker-compose run twint -u username -es elasticsearch:9200
docker-compose run twint -s "#osint" -es elasticsearch:9200
docker-compose run twint -u username -es elasticsearch:9200 --json -o /opt/twint/username.json
USERNAME=username docker-compose run twint -u ${USERNAME} -es elasticsearch:9200 --json -o /opt/twint/${USERNAME}.json

if local install of twint

twint -u username -es localhost:9200
twint -u username -es localhost:9200 --json -o /opt/twint/username.json

Search engine

  • Allows to do faceted search
  • Current build is developpment so you can do change and re-compile in real-time.
open http://localhost:3000

Debug Elasticsearch

open http://localhost:9000
open http://localhost:9200/twinttweets/_search?pretty=true&q=*:*
open http://localhost:9200/twinttweets/_count?pretty

Screenshots

alt text

alt text

Known Issues ⚠️

I have noticed when running the new 5.0+ version on a linux host you need to increase the memory map areas with the following command

sudo sysctl -w vm.max_map_count=262144

More at https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html

Issues

Find a bug? Want more features? Find something missing in the documentation? Let me know! Please don't hesitate to file an issue

To do

  • Embed video in tweets
  • Tweet with images
  • Tweet with location
  • Filter re-tweets
  • All the most crazy things possible
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].