I’m currently enjoying the summer time with a bit of research, I’ve been set on to doing for a long time. The topic is de-mosaic, and I’ve had my mind set on trying out using neural networks for this task.
Again, I base my choice of are on an AviSynth plugin, named ‘nnedi‘ (short for Neural Network Edge Directed Interpolation), which was written by tritical, AKA Kevin Stone. It is a filter that doubles the height of the image with very impressive results. Unlike many of his other works, this is not GPL, so there is no direct reference, but even though he wants to keep some aspects secret, due to his research, he is very open and has already given me some pointers in the right direction.
My basic idea is to see if something in the same line can be used for bayer grid de-mosaic, so you feed the local area of the pixel value to be interpolated into a neural network, and learn it to output the missing values.
Right now I’m still in the research phase, and trying to mock together some code just to see how well the theory maps to practice, and I’ve already learned a lot – but starting form virtually nothing, that doesn’t say much! ;)
I’ll keep you posted when I get something more working.