Stereo capturing by plenoptic and 2D cameras

  • Swimlane: Current
  • Column: DONE
  • Position: 1
  • Assignee: Mehrdad Teratani
  • Creator: Rudy Ercek
  • Started: 01/10/2020 00:00
  • Created: 30/09/2020 16:03
  • Modified: 27/09/2023 17:56
  • Moved: 27/09/2023 17:56
Description

Abstract:

In a Plenoptic camera, through a microlens array (MLA), the real-world is captured from multiple angles. The MLA is placed next to the image sensing sensor, and a Lenslet (LL) image. A LL image which consists of light rays from different angles, contains the 3-D information of the scene. An LL image can always be converted to multiview (MV) images (e.g. 5x5). When a plenoptic camera is stereo-paired with a normal 2D camera due to different optics, the captured contents are not identical. In this project, we want to synthesize equivalent LL and/or MV images at the location of the 2D camera, given the images captured in LL and 2D formats by the stereo set up The challenges in the project consists of understanding the plenoptic camera optics, calibration, depth estimation and view synthesis.

Keywords:

Plenoptic camera, 3D acquisition systems, Calibration, Depth estimation, View synthesis

Supervisor:

Mehrdad Teratani (mehrdad.teratani@ulb.be), Gauthier Lafruit (gauthier.lafruit@ulb.be)

Director:

Mehrdad Teratani (mehrdad.teratani@ulb.be)

Sub-Tasks
Internal links
Comments