deep learning

Set of KNIME workflows for the training of a deep learning model for image-classification with custom images and classes.

The workflows take ground-truth category annotations as a table generated by the qualitative annotations plugins in Fiji.

Workflows for the training of a model AND for the prediction of image-category for new images are provided.

There are different workflows if you do:

- binary image-classification (images get classified in 1 category out of 2 possible categories) 

- classification from possibly more than 2 categories (images are classified in 1 category out of N possible categories).

The training workflows take care of image pre-processing and allows the visualization of the training and validation losses in real time along the training.  

For the training, transfer learning from a pre-trained VGG16 base is performed, with freshly initialized fully connected layers.

Only the fully connected layers are trained, the VGG16 base is frozen is this workflow, but once the fully connected layers trained the base could also be finetuned. In practice, it often works well with the frozen base.

U-Net segmentation as presented in Reference Publication. The model predicts three classes: background, edge and foreground. The model was trained with Kaggle Data Science Bowl (DSB) 2018 training set.

Nuclei Segmentation using Deep Learning for individual cell analysis (DeepCell).

PyTorch is an open-source machine learning library for Python, based on Torch, used for applications such as natural language processing.

ImJoy is a plugin powered hybrid computing platform for deploying deep learning applications such as advanced image analysis tools.

ImJoy runs on mobile and desktop environment cross different operating systems, plugins can run in the browser, localhost, remote and cloud servers.

With ImJoy, delivering Deep Learning tools to the end users is simple and easy thanks to its flexible plugin system and sharable plugin URL. Developer can easily add rich and interactive web interfaces to existing Python code.