All Projects → phillipdupuis → Dtale Desktop

phillipdupuis / Dtale Desktop

Licence: mit
Build a data visualization dashboard with simple snippets of python code

Programming Languages

python
139335 projects - #7 most used programming language
typescript
32286 projects

Projects that are alternatives of or similar to Dtale Desktop

Sweetviz
Visualize and compare datasets, target values and associations, with one line of code.
Stars: ✭ 1,851 (+1346.09%)
Mutual labels:  data-science, data-analysis, pandas, data-visualization
Dtale
Visualizer for pandas data structures
Stars: ✭ 2,864 (+2137.5%)
Mutual labels:  data-science, data-analysis, pandas, data-visualization
Seaborn Tutorial
This repository is my attempt to help Data Science aspirants gain necessary Data Visualization skills required to progress in their career. It includes all the types of plot offered by Seaborn, applied on random datasets.
Stars: ✭ 114 (-10.94%)
Mutual labels:  data-science, data-analysis, pandas, data-visualization
Deepgraph
Analyze Data with Pandas-based Networks. Documentation:
Stars: ✭ 232 (+81.25%)
Mutual labels:  data-science, data-analysis, pandas, data-visualization
Dat8
General Assembly's 2015 Data Science course in Washington, DC
Stars: ✭ 1,516 (+1084.38%)
Mutual labels:  data-science, data-analysis, pandas, data-visualization
Data Science Hacks
Data Science Hacks consists of tips, tricks to help you become a better data scientist. Data science hacks are for all - beginner to advanced. Data science hacks consist of python, jupyter notebook, pandas hacks and so on.
Stars: ✭ 273 (+113.28%)
Mutual labels:  data-science, data-analysis, pandas, data-visualization
Seaborn
Statistical data visualization in Python
Stars: ✭ 9,007 (+6936.72%)
Mutual labels:  data-science, pandas, data-visualization
Pythondata
repo for code published on pythondata.com
Stars: ✭ 113 (-11.72%)
Mutual labels:  data-science, data-analysis, data-visualization
Rightmove webscraper.py
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
Stars: ✭ 125 (-2.34%)
Mutual labels:  data-science, data-analysis, pandas
Awesome Business Intelligence
Actively curated list of awesome BI tools. PRs welcome!
Stars: ✭ 1,157 (+803.91%)
Mutual labels:  data-science, data-analysis, data-visualization
Data Science Lunch And Learn
Resources for weekly Data Science Lunch & Learns
Stars: ✭ 49 (-61.72%)
Mutual labels:  data-science, data-analysis, data-visualization
Graphia
A visualisation tool for the creation and analysis of graphs
Stars: ✭ 67 (-47.66%)
Mutual labels:  data-science, data-analysis, data-visualization
My Journey In The Data Science World
📢 Ready to learn or review your knowledge!
Stars: ✭ 1,175 (+817.97%)
Mutual labels:  data-science, data-analysis, data-visualization
Openrefine
OpenRefine is a free, open source power tool for working with messy data and improving it
Stars: ✭ 8,531 (+6564.84%)
Mutual labels:  data-science, data-analysis, data-visualization
Ds and ml projects
Data Science & Machine Learning projects and tutorials in python from beginner to advanced level.
Stars: ✭ 56 (-56.25%)
Mutual labels:  data-science, pandas, data-visualization
Data Science For Marketing Analytics
Achieve your marketing goals with the data analytics power of Python
Stars: ✭ 127 (-0.78%)
Mutual labels:  data-science, pandas, data-visualization
Superset
Apache Superset is a Data Visualization and Data Exploration Platform
Stars: ✭ 42,634 (+33207.81%)
Mutual labels:  data-science, data-analysis, data-visualization
Pandas Videos
Jupyter notebook and datasets from the pandas Q&A video series
Stars: ✭ 1,716 (+1240.63%)
Mutual labels:  data-science, data-analysis, pandas
Datasist
A Python library for easy data analysis, visualization, exploration and modeling
Stars: ✭ 123 (-3.91%)
Mutual labels:  data-science, data-analysis, data-visualization
Data Forge Ts
The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.
Stars: ✭ 967 (+655.47%)
Mutual labels:  data-analysis, pandas, data-visualization

preview


An interface for saving python scripts as permanent D-Tale launch points.

PyPI version Code style: black


Getting started

Installation

$ pip install dtaledesktop

Running it from the command line:

$ dtaledesktop

Running it from a python script:

import dtale_desktop

dtale_desktop.run()

Motivation

dtaledesktop simplifies the process of fetching data, cleaning/transforming it, and then performing exploratory data analysis. With dtaledesktop, that entire process is condensed into a single click.

It does this by providing a dashboard GUI, and any python code which returns a pandas DataFrame can be saved to the dashboard as a widget. Users can then execute that code and explore the DataFrame in dtale or pandas-profiling by simply clicking one of the widget buttons. The code associated with that widget can also be edited directly from the dashboard, and upon doing so the dashboard is updated in real-time.

Here's a simple example of using this workflow:

  1. launch dtaledesktop from a terminal. The dashboard automatically opens up in your web browser.
  2. click the 'Add Data Source' button, fill out the form like so, and click save: preview
  3. and bam! You now have a new 'Stocks' section on your dashboard. It will be there every time you launch dtaledesktop, and the python code can be edited directly from the dashboard: preview

If at some point you decide you want to watch Apple too, all you need to do is click the "Settings" button and add "AAPL" to the list of stock symbols. It will immediately appear in the dashboard below TSLA.


How it works

The front end is written with react, using a mixture of ant-design and styled-components.

The back end is written in python, and it actually consists of TWO apps which listen on separate ports. The main one is an asynchronous FastAPI application, and it responsible for communicating with the dashboard, interacting with the file system, and executing user-defined code for fetching/transforming data. It is able to do this by saving the submitted code as persistent files and then using importlib.util to build and then import the resulting modules. The second app is for running dtale instances, and it is a synchronous flask application.


Developers/Contributing

First, you'll want to clone the repo and install the python dependencies:

$ git clone https://github.com/phillipdupuis/dtale-desktop.git
$ cd dtale-desktop
$ python setup.py develop

Then you'll need to install the javascript dependencies and build the react app:

$ cd dtale_desktop/frontend
$ npm install
$ npm run build

And now you should be able to launch it like so:

$ python dtale_desktop/app.py

If you want to modify the front-end, do the following:

  1. Launch the python app in the normal way
  2. Change the "proxy" setting in frontend/package.json to point at the host/port the python app is running on.
  3. npm start to launch the react app. It will run on a different port, but will proxy unknown requests to the python app.

Settings

Disabling features:

Environment Variable Description
DTALEDESKTOP_DISABLE_ADD_DATA_SOURCES "true" if the "Add Data Source" button should not be shown.
DTALEDESKTOP_DISABLE_EDIT_DATA_SOURCES "true" if editing existing data sources should not be allowed.
DTALEDESKTOP_DISABLE_EDIT_LAYOUT "true" if users should not be allowed to edit what sources are visible or what order they're in.
DTALEDESKTOP_DISABLE_PROFILE_REPORTS "true" if the "Profile" option (which builds a pandas_profiling report) should not be shown. This is resource-intensive and currently a bit buggy.
DTALEDESKTOP_DISABLE_OPEN_BROWSER "true" if browser should not open upon startup
DTALEDESKTOP_DISABLE_DTALE_CELL_EDITS "true" if editing cells in dtale should be disabled.

Routing requests:

Environment Variable Description
DTALEDESKTOP_HOST host it will run on
DTALEDESKTOP_PORT port the main application will use
DTALEDESKTOP_DTALE_PORT port the dtale application will use
DTALEDESKTOP_ROOT_URL allows you to override how urls are built, which can be useful if you're running it as a service (ie not locally)
DTALEDESKTOP_DTALE_ROOT_URL added in order to support running dtaledesktop in k8s - by using different domain names for the main app and the dtale app, the ingress controller can use that (domain name) to determine which port requests should be sent to.
DTALEDESKTOP_ENABLE_WEBSOCKET_CONNECTIONS "true" if real-time updates should be pushed to clients via websocket connection. This is only useful/necessary if you are running it as a service and multiple users can access it simultaneously.

Loaders/file storage:

Environment Variable Description
DTALEDESKTOP_ROOT_DIR the location where all persistent data (loaders, cached data, etc.) will be stored. By default this is ~/.dtaledesktop
DTALEDESKTOP_ADDITIONAL_LOADERS_DIRS comma-separated list of directory paths that should be scanned for data sources upon startup
DTALEDESKTOP_EXCLUDE_DEFAULT_LOADERS "true" if the default loaders should not be included in the list of data sources. These are the loaders which look for json, csv, and excel files in your home directory.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].