tirthajyoti / Web Database Analytics
Licence: mit
Web scrapping and related analytics using Python tools
Stars: ✭ 175
Programming Languages
python
139335 projects - #7 most used programming language
Labels
Projects that are alternatives of or similar to Web Database Analytics
Data Science Best Resources
Carefully curated resource links for data science in one place
Stars: ✭ 1,104 (+530.86%)
Mutual labels: data-science, sql, analytics, data-wrangling, database
Trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Stars: ✭ 4,581 (+2517.71%)
Mutual labels: data-science, sql, analytics, database
Dat8
General Assembly's 2015 Data Science course in Washington, DC
Stars: ✭ 1,516 (+766.29%)
Mutual labels: jupyter-notebook, data-science, web-scraping, natural-language-processing
Spark With Python
Fundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-14.29%)
Mutual labels: jupyter-notebook, sql, analytics, database
Openml R
R package to interface with OpenML
Stars: ✭ 81 (-53.71%)
Mutual labels: jupyter-notebook, data-science, database
Sayn
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
Stars: ✭ 79 (-54.86%)
Mutual labels: data-science, sql, analytics
Electrocrud
Database CRUD Application Built on Electron | MySQL, Postgres, SQLite
Stars: ✭ 1,267 (+624%)
Mutual labels: sql, database, sqlite3
Codesearchnet
Datasets, tools, and benchmarks for representation learning of code.
Stars: ✭ 1,378 (+687.43%)
Mutual labels: jupyter-notebook, data-science, natural-language-processing
Awesome Business Intelligence
Actively curated list of awesome BI tools. PRs welcome!
Stars: ✭ 1,157 (+561.14%)
Mutual labels: data-science, sql, database
Ml
A high-level machine learning and deep learning library for the PHP language.
Stars: ✭ 1,270 (+625.71%)
Mutual labels: data-science, analytics, natural-language-processing
Learnpythonforresearch
This repository provides everything you need to get started with Python for (social science) research.
Stars: ✭ 163 (-6.86%)
Mutual labels: jupyter-notebook, data-science, web-scraping
Fixy
Amacımız Türkçe NLP literatüründeki birçok farklı sorunu bir arada çözebilen, eşsiz yaklaşımlar öne süren ve literatürdeki çalışmaların eksiklerini gideren open source bir yazım destekleyicisi/denetleyicisi oluşturmak. Kullanıcıların yazdıkları metinlerdeki yazım yanlışlarını derin öğrenme yaklaşımıyla çözüp aynı zamanda metinlerde anlamsal analizi de gerçekleştirerek bu bağlamda ortaya çıkan yanlışları da fark edip düzeltebilmek.
Stars: ✭ 165 (-5.71%)
Mutual labels: jupyter-notebook, data-science, natural-language-processing
Covid19 Dashboard
A site that displays up to date COVID-19 stats, powered by fastpages.
Stars: ✭ 1,212 (+592.57%)
Mutual labels: jupyter-notebook, data-science, analytics
Sqlcheck
Automatically identify anti-patterns in SQL queries
Stars: ✭ 2,062 (+1078.29%)
Mutual labels: sql, database, sqlite3
Suspeitando
Projeto de análise de contratos com suspeita de superfaturamento e má qualidade na prestação de serviços.
Stars: ✭ 76 (-56.57%)
Mutual labels: jupyter-notebook, data-science, analytics
Ds With Pysimplegui
Data science and Machine Learning GUI programs/ desktop apps with PySimpleGUI package
Stars: ✭ 93 (-46.86%)
Mutual labels: jupyter-notebook, data-science, analytics
Griffon Vm
Griffon Data Science Virtual Machine
Stars: ✭ 128 (-26.86%)
Mutual labels: jupyter-notebook, data-science, database
Interactive machine learning
IPython widgets, interactive plots, interactive machine learning
Stars: ✭ 140 (-20%)
Mutual labels: jupyter-notebook, data-science, analytics
Eventql
Distributed "massively parallel" SQL query engine
Stars: ✭ 1,121 (+540.57%)
Mutual labels: sql, analytics, database
Etl with python
ETL with Python - Taught at DWH course 2017 (TAU)
Stars: ✭ 68 (-61.14%)
Mutual labels: jupyter-notebook, data-science, database
Web scraping, database and related analytics
Dr. Tirthajyoti Sarkar (You can connect with me on LinkedIn)
Requirements
- Python 3.5+
- NumPy (
$ pip install numpy) - Pandas (
$ pip install pandas) - requests (
$ pip install requests) - BeautifulSoup4 (
$ pip install beautifulsoup4) - MatplotLib (
$ pip install matplotlib)
My new book on Data wrangling with Python
What type of Notebooks are here?
- Web scraping and related analytics using Python tools
- Fundamentals of Regular expressions (Regex)
- Application of urllib
- Application of BeautifulSoup for HTML parsing
- Application of ElementTree for XML parsing
- Application of Python json library for JSON parsing
- Application of Python sqlite library (building a personal movie database)
How to design your own mini-IMDB movie database by scraping web?
Check out this article I wrote on Medium about this topic
How to scrape data from CIA website (this is harmless, I promise) about simple facts on various nations?
Check out this article I wrote on Medium about this topic
How to build a Yelp crawler which can generate interesting word cloud based on a particular city's food cuisine and taste?
How to crawl the Project Gutenberg portal and download 100 most popular books automatically?
How to use a free API to download basic information about countries around the world and build a database?
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].