影像復原，是指將影像中被遮蔽物所遮蔽的區域，加以填補的動作。其主要目的是希望能復原出原先被遮蔽的影像資訊。此技術可應用在老舊照片折痕的修補、照片上文字的去除、欄杆的移除等。本研究即是提出了一個基於影像復原之柵欄移除技術，自動化填補未知區域的影像資訊，從一張靜態的數位影像上，移除前方的柵欄，顯現出柵欄後面的影像資訊。

柵欄移除技術，主要是利用兩大步驟：邊緣偵測和漸進演算法。
第一步驟，利用索貝爾(Sobel)的邊緣偵測特性，將影像中邊緣線找出來；接著利用柵欄的性質，對柵欄進行估測，刪除不是柵欄的邊緣及雜訊，以及修補斷掉的柵欄邊緣線，呈現出影像中柵欄的位置。
第二步驟，對已判別出柵欄的區域進行移除，並修補原先被柵欄遮蔽的影像資訊，此方法藉著柵欄區周圍的資訊，進行顏色漸進的效果來達到復原影像。
利用上面的兩大步驟，可以對單張靜態的數位影像，進行柵欄移除，並對原先被遮蔽的部分進行復原影像資訊，而呈現出無柵欄的完整影像。

Image inpainting is to fill in the areas hiding from view. Its main purpose is to recover out the image information originally covered. The technology can be applied to old photos that have some creases, and get rid of characters, move fences, etc. on photos. Research here is a method based on the image inpainting technology that can remove the fence on a static photo. It can automatically fill in image information of unknown area. It can remove the fence in front of a piece of static image. Then it displays image information behind the fence.
The technology of removing fence mainly utilize two major steps: detect the edge and a step by step color algorithm.
The first step, it utilizes the characteristics on Sobel Edge Detection to find out the edge line in an image. Aftter that, it utilizes the nature of the fence to delete the edge and miscellaneous noise that is not belonged to the fence. It also repairs the fence edge line shed to break. Then it demonstrates the position of the fence of the image.
Second step, it removes the area of fences that have already found. It recovers image information that covers by fence. The method use the step by step color algorithm to reach the image of inpainting by information around the fences.
Utilizing two major steps above, it can move the fence from a single and static image and recover the information under the fence.

[01] A. C. Kokaram, R. D. Morris, W. J. Fitzgerald, and P. J. W. Rayner. Detection of Missing Data in Image Sequences. IEEE Trans. Image Processing, 4(11):1496–1508, Nov. 1995.

[02] Kokaram A.C. “Detection and removal of line scratches in degraded motion picture sequences”. Signal Processing VIII: theories and Application, proceedings of EUSIPCO-96, Trieste, Italy, 1996.

[03] Li S.Z., Chan K.L., Wang H. Bayesian . “Image restoration and segmentation by constrained optimization”. CVPR'96, Int. Con$ on Computer Vision and Pattern
Recognition, pages 1-6, 1996.

[04] J. De Bonet. Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images. In Computer Graphics (SIGGRAPH ’97 Conf. Proc.), Pages 361–368, Aug. 1997.

[05] IGEHY, H., AND PEREIRA, L. 1997. “Image replacement through texture synthesis”. In IEEE International conference on Image Processing, vol. 3, 186–189

[06] Masnou, S. and Morel, J.-M., “Level lines based disocclusion”, Image Processing, 1998. ICIP 98. Proceedings. 1998 International Conference on 4-7 Oct. 1998, Page(s):259 - 263 Vol.3 .

[07] Zhou Wang, Yinglin Yu and Zhang, D., “Best Neighborhood Matching: An Information Loss Restoration Technique for Block-Based Image Coding Systems”, Image Processing, IEEE Transactions on Vol. 7, July 1998, Page(s):1056 – 1061.

[08] W. Freeman and E. Pasztor. Learning to estimate scenes from images. In M. Kearns, S. Solla, and D. Cohn, editors, Adv. Neural Information Processing Systems 11. MIT Press, 1999.

[09] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, “Image Inpainting”, in Proc. ACM Conf. Comp. Graphics(SIGGRAPH), New Orleans, USA, July 2000.

[10] Wei, L. W., and Levoy, M. “ Fast texture synthesis using tree-structured vector quantization”. In Proceedings of ACM SIGGRAPH 2000, 479–488, 2000.

[11] M. Oliveira, B. Bowen, R. McKenna, and Y. -S. Chang. “Fast Digital Image Inpainting.” in Proc. VIIP 2001, pp. 261—266, [CITY]: [PUB], 2001.

[12] Bertalmio, M., Bertozzi, A.L., and Sapiro, G., “Navier-stokes, fluid dynamics, and image and video inpainting”, Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on Vol.1, 2001, Page(s): I-355 - I-362.

[13] T. F. Chan and J. Shen, “Nontexture Inpainting by Curvature-Driven Diffusions,” Journal of Visual Communication and Image Representation, V. 12, N. 4, pp. 436-449, 2001.

[14] Y. Weiss and W. Freeman. “On the optimality of solutions of the max-product belief propagation algorithm in arbitrary graphs”. IEEE Transactions on Information Theory, 47(2):723–735, 2001.

[15] C. Ballester, M. Bertalmio, V. Caselles, G. Sapiro, and J. Verdera. “Filling-in by joint interpolation of vector fields and gray levels”. IEEE Trans. Image Processing, 10(1), August 2001.

[16] L. Ying, A. Hertzmann, H. Biermann, and D. Zorin. “Texture and Shape Synthesis on Surfaces”. In Rendering Techniques 2001, pages 301–312, 2001.

[17] L. Liang, C. Liu, Y. Xu, B. Guo, and H.-Y. Shum. Real-Time Texture Synthesis Using Patch-Based Sampling. ACM Transactions on Graphics, 20(3):127–150, July 2001.

[18] A A. Efros and W. T. Freeman. Image Quilting for Texture Synthesis and Transfer. In Computer Graphics (SIGGRAPH ’01 Conf. Proc.), pages 341–346, Aug. 2001.

[19] 陳向筠，史天元，2001，『最鄰近勻化法探討』網址：http://nhmrc.cv.nctu.edu.tw/People/tyshih/Publications/GIS2001/%B3%CC%BEF%AA%F1%A4%C3%A4%C6%AAk%B1%B4%B0Q0802.pdf

[20] R. Bornard, E. Lecan, L. Laborelli, and J. Chenot, “Missing data correction in still images and image sequences”, December 2002, Proceedings of the tenth ACM international conference on Multimedia.

[21] Wei-Qi Yan and Kankanhalli, M.S., “Erasing video logos based on image inpainting”, Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on Vol. 2, 26-29 Aug. 2002 Page(s):521 – 524.

[22] T. Chan and J. Shen. “Mathematical models for local nontexture inpaintings”. SIAM Journal on Applied Mathematics, 62(3):1019–1043, 2002.

[23] BROOKS, S., AND DODGSON, N. 2002. Self-similarity based texture editing.
ACM Transactions on Graphics, 21, 3, 653–656.

[24] BORENSTEIN, E., AND ULLMAN, S. 2002. “Class-specific, top-down segmentation”. In European Conference on Computer Vision, 109–124.

[25] FREEMAN, W. T., JONES, T. R., AND PASZTOR, E. 2002. “Example-based super-resolution”. IEEE Computer Graphics and Applications, 56–65.

[26] Yamauchi, H., Haber, J., and Seidel, H.-P., “Image restoration using multiresolution texture synthesis and image inpainting”, Computer Graphics International, 2003. Proceedings 9-11 July 2003 Page(s):120 – 125.

[27] I. Drori, D. Cohen-Or, and H. Yeshurun, “Fragment-based image completion”,
July 2003, ACM Transactions on Graphics (TOG), Vol. 22.

[28] R.J Cant, and C.S Langensiepen , “A multiscale method for automated inpainting”, 17th European Simulation Multiconference, 2003 - ducati.doc.ntu.ac.uk Page 1.

[29] Shih, T.K., Liang-Chen Lu, Ying-Hong Wang, and Rong-Chi Chang, “Multi-resolution image inpainting”, Multimedia and Expo, 2003. ICME '03.
Proceedings. 2003 International Conference on Vol.1, 6-9 July 2003, Page(s):I - 485-8.

[30] Levin, A., Zomet, A., and Weiss, Y., “Learning how to inpaint from global image statistics”, Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on 2003, Vol.1, Page(s):305 – 312.

[31] M. Bertalmio, L. Vese, G. Sapiro, and S. Osher. “Simultaneous structure and texture image inpainting”. In IEEE Conf. on Computer Vision and Pattern Recognition, 2003.

[32] A Telea - Journal of Graphics Tools, “An image inpainting technique based on the fast marching method” 2004 - win.tue.nl, Page 1. Vol. 9, No. 1: 25—36.

[33] Sharf, A., Alexa, M., and Cohen-Or, D. “Context-based surface completion”. In Proceedings of ACM SIGGRAPH 2004, 878–887.

[34] Shih, T.K., Rong-Chi Chang, Liang-Chen Lu, and Huan-Chi Huang, “Multi-layer inpainting on Chinese artwork”, Multimedia and Expo, 2004. ICME '04. 2004 IEEE International Conference on Vol.1, 27-30 June 2004, Page(s):21 – 24.

[35] Criminisi, A., Perez, P., and Toyama, K., “Region filling and object removal by exemplar-based image inpainting”, Image Processing, IEEE Transactions on Vol.13, Sept. 2004, Page(s):1200 – 1212.

[36] Shih, T.K., Rong-Chi Chang, Liang-Chen Lu, Wen-Chieh Ko, and Chun-Chia Wang, “Adaptive digital image inpainting”, Advanced Information Networking and Applications, 2004. AINA 2004. 18th International Conference on Vol.1, 2004 Page(s):71 – 76.

[37] J Sun, L Yuan, J Jia, HY Shum, “Image Completion with Structure Propagation”, Proceedings of ACM SIGGRAPH ,2005

[38] BianRu Li, Yue Qi, and XuKun Shen, “An image inpainting method”, Computer
Aided Design and Computer Graphics, 2005. Ninth International Conference on 7-10 Dec. 2005 Page(s):6 pp.

[39] Yung, W., Shankar, A. Image Inpainting project. http://ww.people.fas.harvard.edu/~shankar/inpainting/

[40] Bertalmio, M. Marcelo Bertamio’s web site: http://www.ece.umn.edu/users/marcelo/restoration.html

[41] C語言數位影像處理，2006，原著：井上誠喜，八木伸行，林正樹，中須英輔，三谷公二，奧井誠人。

[42] 王冠華，2003，『 多重疊航照立體對半自動房屋模型重建』，國立中央大學土木工程學系碩士論文。

[43] R. Gonzalez and R. Woods, Digital Image Processing, Addison-Wesley Publishing Company, 1992