Instituto de Sistemas e Robótica

João Paulo Costeira Associate Professor Department of Electrical and Computer Eng. Instituto Superior Técnico Email- jpc AT isr.ist.utl.pt Phone (Office) +351-218418292, Ext 2292 Postal Address - Torre Norte, Av. Rovisco Pais, 1049-001  Lisbon, Portugal

Bio PhD in Electrical and Computer Eng. - IST (1995), PhD Thesis -  Motion Segmentation(PDF) -Advisors: Takeo Kanade and João Sentieiro Visiting Scientist  - Robotics Institute - Carnegie Mellon University (1992-1995) -(research report ) Researcher@ Signal and Image Processing Group -  Coordinator of Thematic Area D  - ISR-Associated Laboratory (2007-2011) Co-director of the Dual PhD program in ECE Carnegie Mellon|Portugal  See My Google Scholar Profile Scientific Interests Computer Vision, 3D Reconstruction, Structure from Motion... pretty much everything that involves "sensing" ! Teaching  Computer Vision and Image Processing (PIV -2011 ) Past courses :  Signals&Systems, Circuit Analysis, Control PhD Students Joao Maciel  (2001), Optimal Solution to Correspondence Problems Ricardo Oliveira (2006) Optimal Correspondence through the use of rank constraints Nuno Pinho da Silva (2010)  Robust Nonmetric Perception of Moving Rigid Bodies Ricardo Ferreira (2010) Reconstruction of isometrically embedded flat surfaces from scaled orthographic image data co-advised  with  J. Xavier Manuel Marques  (soon!)  something similar "The Role of Rigidity in Structure from Motion: Unique Solutions in 3D Reconstruction and Object Matching" Susana Brandão - co-advised with Manuela Veloso in  Carnegie Mellon|Portugal Ricardo Cabral - co-advise with Fernando De la Torre & A. Bernardino in Carnegie Mellon|Portugal

My (Computer) Vision

I've been pursuing the idea of creating an artificial vision "machine"  since 1986. Check  CMU's Virtualized Reality  if you are not from the field. I've  had a lot of fun on many subjects but some problems never left my mind: 3D reconstruction and "the correspondence problem".  Those are the problems I've shared with my PhD students and people I had the previlege to collaborate with.

3D Reconstruction  Multiple motion segmentation for rigid and articulated moving objects By tracking points in a video sequence with several objects moving, points are grouped according to "rigidity". Joao P. Costeira, Takeo Kanade - A Multibody Factorization Method for Independent Moving Objects,  International Journal on Computer Vision, 29(3), pp.159-179, Kluwer Academic Publishers, 1998 Nuno P da Silva,  Costeira, J. P.. " The Normalized Subspace Inclusion: Robust Clustering of Motion Subspaces", The Twelfth IEEE International Conference on Conputer Vision (ICCV), Kyoto, Japan, September, 2009. Nuno P da Silva  Costeira, J. P.. " Subspace segmentation with outliers: a Grassmannian approach to the maximum consensus subspace", IEEE  Conference on Conputer Vision and Pattern Recognition (CVPR), Anchorage, Alaska, USA, June, 2008. Thanks to Vargas for the rendering Factorization with missing and degenerate data The 3D model of "Casa da Musica"  is computed from point coordinates in the images. Main contributions: - Uncalibrated reconstruction (images obtained  on google images). - Very dissimilar images - Visible are can be degenrate (planar). State of the art brakes down. This method was used for face recognition . Marques, M., and Costeira, J.. "Estimating 3D shape from degenerate sequences with missing data", Computer Vision and Image Understanding, 113(2):261-272, February 2009.   Marques, M., and Costeira, J.. "3D face recognition from multiple images: a shape-from-motion approach", FG2008 - 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September 2008.  Marques, M., and Costeira, J.. "Optimal shape from motion estimation with missing and degenerate data", WACV-Motion 2008 - IEEE Workshop on Application of Computer Vision, Copper Mountain, CO, USA, January 2008. Reconstruction of "paper like" surfaces. The flat surface is reconstructed from point tracks (with missing data).   Ricardo Ferreira, João Xavier, João Paulo Costeira, Shape from motion of nonrigid objects: the case of isometrically deformable flat surfaces, Proc. of BMVC 2009 - British Machine Vision Conference, London, UK, 2009 Ricardo Ferreira, João Xavier, João Paulo Costeira,Reconstruction of Isometrically Deformable Flat Surfaces in 3D from Multiple Camera Images,  Proc. of ICASSP 2009 - IEEE International Conference on Acoustics, Speech, and Signal Processing, Taipei, Taiwan, 2009  Page under construction :-)