Rishit-dagli / Mirnet Tfjs
Programming Languages
Projects that are alternatives of or similar to Mirnet Tfjs
MIRNet-TFJS 
This repository shows the TFJS model conversion and inference processes for the for the MIRNet model as proposed by Learning Enriched Features for Real Image Restoration and Enhancement by Zamir et al. This model is capable of enhancing low-light images upto a great extent.
Model training code and pre-trained weights are provided by Soumik through this repository.
A bit about the architecture
The MIRNet presents a novel architecture with the collective goals of maintaining high-resolution representations through the entire network, and receiving strong contextual information from the low-resolution representations.
The core of this approach is a multi-scale residual block containing the following key elements:
- parallel multi-resolution convolution streams for extracting multi-scale features
- information exchange across the multi-resolution streams
- spatial and channel attention mechanisms for capturing contextual information
- attention based multi-scale feature aggregation.
Framework of MIRNet
The figure above shows the framework of the proposed network MIRNet that learns enriched feature representations for image restoration and enhancement.
About the notebooks
MIRNet_Saved_Model.ipynb
This notebook shows the the process of downloading pre-trained weights for the MIRNet model and saving it as a SavedModel.
MIRNet_TFJS.ipynb
This notebook shows the the process of converting the SavedModel to the TFJS format we built in the prequel notebook for the MIRNet model. It also shows performing optimizations on this.
MIRNet_Inference.ipynb
This notebook shows the the process of inferencing for the MIRNet model on a couple of low light photos.
Running the TFJS Model, An example
The example can be launched by simply clicking on this button example folder in this repo. As of now this example is a very minimalistic one as you can see in the below image. The example website is deployed on the free tier of Azure App Services so inferences could take quite some time (90 seconds or so) when a lot of folks might be using it at the same time.
Getting Started
To get up and running with this example, run the following commands, make sure you have Node.js installed.
git clone [email protected]:Rishit-dagli/MIRNet-TFJS.git # or clone your own fork
cd MIRNet-TFJS
cd example # switch to the example folder
npm install
npm start
Your app should now be running on localhost:3000 🚀.
Run online on Repl.it
Alternatively you could also get up and running with this example with the free to use online service Repl.it. Get started by clicking on this button after which you would click the Run button on the top or run
npm start and voila your app is now running 🚀.
Troubleshooting
The example folder has a standalone modeltest.js file, which tries to run the model on a specified file and then save the output to test the model. You can test the model with this file through:
git clone [email protected]:Rishit-dagli/MIRNet-TFJS.git # or clone your own fork
cd MIRNet-TFJS
cd example # switch to the example folder
npm install
node modeltest.js
The modeltest.js uses the input.PNG image file in the root directory and outputs a output.Png image file.
Contributors
License
Copyright 2020 Rishit Dagli
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.