Imaging through Non-conventional Fiberscopes (id 7251)

Objectives:

A fiberscope carries imaging through a bundle of optic fibers. In a simple description, one may say that each optic fiber transports "one pixel". Pointing the optic-fiber bundle (cable) according to multiple azimuth and elevation angles allows obtaining multiples images which can be fused to form a panoramic image.

The main objectives of the work are the following:

- mounting a fiberscope based in a standard video camera and a cable of optic fibers,

- mounting one end of the flexible optic-fibers-cable on top of a pan-tilt-basis,

- calibrating the fiberscope in order to obtain images readable by humans,

- obtaining panoramic images by fusing multiple (narrow field) images.

Requirements (grades, required courses, etc):

Localization:

ISR / IST

Observations:

This work has its motivation in recent research which has show that under certain conditions a cross-cut cable of a fiberscope can be reconnected. The disarrangement of the various fiber tips can be estimated by image processing methodologies. The work is originally inspired by the, still distant, biological goal of reconnecting damaged optic nerves.

Previous works conducted at ISR/IST provide good starting points for the thesis. In particular a number of hardware prototypes already exist, together with a number of datasets.

References:

[Bouguet-WWW] Jean-Yves Bouguet, "Camera calibration toolbox for matlab", http://www.vision.caltech.edu/bouguetj/calib_doc/

[Hassanpour04] Camera auto-calibration using a sequence of 2D images with small rotations, Reza Hassanpour, Volkan Atalay, Pattern Recognition Letters, Vol.25, Issue 9, 2 July 2004, Pages 989-997

[Agapito01] Agapito, L., Hayman, E., Reid, I.D., 2001. Self calibration of rotating and zooming cameras. Int. J. Comput. Vision 45(2), 107–127.

[Neumann05] "Compound Eye Sensor for 3D Ego Motion Estimation", Jan Neumann, Cornelia Fermuller, Yiannis Aloimonos, Vladimir Brajovic, IROS 2005, see also http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.147.929

[Grossmann10] "Discrete camera calibration from pixel streams", Etienne Grossmann, José António Gaspar and Francesco Orabona, Computer Vision and Image Understanding (Special issue on Omnidirectional Vision, Camera Networks and Non-conventional Cameras), Volume 114, Issue 2, Pages 198-209, February 2010.

[Galego13] "Topological Auto-Calibration of Central Imaging Sensors", R. Galego, R. Ferreira, A. Bernardino, E. Grossmann and J. Gaspar, IbPRIA 2013

[Galego14] "Discrete Camera Autocalibration Consistent with the Frame of the Robotic Pan-Tilt Basis", R. Galego, R. Ferreira, A. Bernardino, E. Grossmann, J. Gaspar, Procedia Technology 17, 186-193, 2014 Elsevier

More information about this project:

http://users.isr.tecnico.ulisboa.pt/~jag/msc/msc_2017_2018.html