Alessio Del Bue Homepage

Non-rigid 3D shape recovery using stereo factorization

We address the problem of recovering 3D nonrigid structure from a sequence of images taken with a stereo pair. We have extended the existing non-rigid factorization algorithms to the stereo camera case and presented an algorithm to decompose the measurement matrix into the motion of the left and right cameras and the 3D shape, represented as a linear combination of basis-shapes.

Linear Stereo Factorization The proposed linear method is able to reconstruct a reliable flexible 3D shape given an uncalibrated stereo setup. As a result we can infer the structure in the absence of rigid motion of the observed object. Our experiments with real data show that improved reconstructions can be achieved using this method.

Non-linear Stereo Factorization We perform a non-linear optimization step that minimizes image reprojection error and impose the correct structure to the motion matrix. While this optimization step is proposed for the stereo camera case, it can be readily applied to the case of non-rigid structure recovery using a monocular video sequence.

References on Stereo-Motion:

• A. Del Bue and L. Agapito, "Stereo non-rigid factorization," International Journal of Computer Vision, vol. 66, iss. 2, pp. 193-207, 2006.
  @Article{DelBue:Agapito:IJCV2006,
  author = {A. {Del Bue} and L. Agapito},
  title = {Stereo non-rigid factorization},
  journal = {International Journal of Computer Vision},
  year = {2006},
  volume = {66},
  number = {2},
  pages = {193--207},
  month = {February}
}
  bibtex

• A. Del Bue and L. Agapito, "Non-rigid 3D shape recovery using stereo factorization," Asian Conference of Computer Vision, vol. 1, pp. 25-30, 2004.
  @Article{DelBue:Agapito:2004,
  author = {A. {Del Bue} and L. Agapito},
  title = {Non-rigid {3D} shape recovery using stereo factorization},
  journal = {Asian Conference of Computer Vision},
  year = {2004},
  month = {January},
  volume = {1},
  address = {Jeju, South Korea},
  pages = {25-30}
}
  bibtex

• A. Del Bue and L. Agapito, "Non-rigid Stereo-Motion," , Stolkin, R., Ed., , 2007.
  @InCollection{DelBue:Agapito:2007,
  author = "A. {Del Bue} and L. Agapito", title = "Non-rigid Stereo-Motion", booktitle = "Scene Reconstruction, Pose Estimation and Tracking", year = "2007", editor = "Rustam Stolkin" }
  bibtex