Assignment 2
Vision and Image
Given stereo image pairs (three stereo pairs are provided in ), you are required to write a program with C++ or Python or Matlab to compute the the Disparity Maps of each left (view1) image.
For each stereo pair, the two images (named view1.png and view5.png) are already rectified so that all image motion is purely horizontal. Ground-truth disparity maps of the left view (view1) are also provided for reference.
The reconstructed results will be evaluated by Peak_Signal-to-Noise_Ratio (PSNR): https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio . You can use the source code implemented by Matlab (https://www.mathworks.com/help/vision/ref/psnr.html) or Python ( https://cvnote.ddlee.cc/2019/09/12/psnr-ssim-python ) for PSNR calculation. The PSNR is calculated against the ground-truth disparity map. The higher PSNR you can achieve, the better performance you will get.
Hints:
To complete the task, if you select OpenCV, the following OpenCV functions you can use:
oxfeatures2d.SIFT_create() // SIFT
oBFMatcher() // feature matching
ofindFundamentalMat() // fundamental matrix
ocomputeCorrespondEpilines() // epipolar line
ostereoRectifyUncalibrated() // image rectification
owarpPerspective() // perspective warping
Deep learning based methods can also be adopted. For example, you can use external datasets for model pretraining.
Submission
Please zip the followings and submit to Canvas:
Computer program: Python/Matlab/C++ recommended. If you want to use another program language, please send an email to the TA .
Submission Files: The following files should be provided: a. three disparity maps estimated by your program, as well as the PSNR results of reconstructed disparity maps (30%); b. source code (20%); c. report (academic writing 25%, novelty of method 25%).
Report: Report should be brief and no more than 6 pages. The report should briefly describe and analyze your methods.
Deadline
The submission should be done before 12-Apr 2023, 04:00pm.
Penalty on late submission: 20% of marks will be deducted per day. No submission will be allowed after five days from the deadline. Do NOT copy code from the internet and do not borrow other people’s code. Remember that PLAGIARISM is a serious offense for which you may fail the class or even be expelled from the university.