Prototypical Networks
Artificial Intelligence is the new electricity - Andrew NG
The change occurred in our life after the expeditious growth in AI and deep learning, in particular, is a solid example of this. The research is booming at unprecedented speed and lives of thousands of people have been improved. If AI is the new electricity then definitely data is the new coal. But recently we’ve seen hazardous depletion in the amount of coal in our environment. This resulted in the development of new technologies which needed a fraction of coal or even no coal at all. Similarly, there are many applications in artificial intelligence where we only have meager data or even no data at all. Hence, we need new techniques to perform well in them. Such problems resulted in the growth of a very popular field, the field of N-shot learning.
To know about it more, go to my blog at N-Shot Learning: Learning More with Less Data.
To check out how this works, go to my notebook at kaggle
 |
 |
Dataset
The network was trained on the Omniglot dataset. The Omniglot data set is designed for developing more human-like learning algorithms. It contains 1623 different handwritten characters from 50 different alphabets.
How to use the Module
First install all the necessary dependencies
pip3 install -r requirements.txt- Download the dataset and save it in the directory
- To train, test and save your own model first import the PrototypicalNet module
from prototypicalNet import PrototypicalNet, train_step, test_step, load_weights# Initializing prototypical net
protonet = PrototypicalNet(use_gpu)You can use a pretrained model
# Using Pretrained Model
protonet = load_weights('./protonet.pt', protonet, use_gpu)Or simply train one by yourself
import torch.optim as optim
# Set training iterations and display period
num_episode = 16000
frame_size = 1000
trainx = trainx.permute(0, 3, 1, 2)
testx = testx.permute(0, 3, 1, 2)
# Initializing prototypical net
protonet = PrototypicalNet(use_gpu)
optimizer = optim.SGD(protonet.parameters(), lr = 0.01, momentum=0.99)
# Training loop
frame_loss = 0
frame_acc = 0
for i in range(num_episode):
loss, acc = train_step(protonet, trainx, trainy, 5, 60, 5, optimizer)
frame_loss += loss.data
frame_acc += acc.data
if((i+1) % frame_size == 0):
print("Frame Number:", ((i+1) // frame_size), 'Frame Loss: ',frame_loss.data.cpu().numpy().tolist() /
frame_size, 'Frame Accuracy:', (frame_acc.data.cpu().numpy(.tolist() * 100) / frame_size)
frame_loss = 0
frame_acc = 0To know more checkout this
Want to use a customized model?
No worries, simply download the code and make suitable changes here
Project Manager
