// the find
junyanz/light-field-video
Light field video applications (e.g. video refocusing, focus tracking, changing aperture and view)
Research code from a SIGGRAPH 2017 paper on light field video — lets you interactively refocus video, change aperture, and shift viewpoint after capture using a hybrid camera + neural network pipeline. Aimed at researchers reproducing or building on the paper, not practitioners looking for a production tool.
The interactive viewer is genuinely useful for exploring the technique — mouse-driven refocusing and aperture control make the paper's contributions tangible rather than just static figures. The C++/Qt/OpenCV stack is straightforward to follow for anyone coming from computer vision. The dataset download script and sample sequences (cats, dancing, train) mean you can run it without your own light field hardware. Build system is vanilla CMake, no exotic toolchain.
Abandoned since August 2020 and depends on Caffe for the disparity estimation side — Caffe is effectively dead and getting it running on a modern system is a significant hurdle. The training code isn't in this repo; it's a separate zip download from a university web server that may or may not still exist. Linux-only in practice despite the README hedge about OSX/Windows. With 209 stars in nine years, there's no community and no expectation of issues getting answered.