Jaehyup Lee' Paper Accepted for IEEE TGRS Journal

Congratulations!

Jaehyup Lee' Paper has been accepted for IEEE Transactions on Geoscience and Remote Sensing (IF 8.125).

Title: CFCA-SET: Coarse-to-Fine Context-Aware SAR-to-EO Translation with Auxiliary Learning of SAR-to-NIR Translation

Authos: Jaehyup Lee, Hyebin Cho, Doochun Seo, Hyun-ho Kim, Jaeheon Jeong, and Munchurl Kim

Abstract:

Satellite Synthetic Aperture Radar (SAR) images are immensely valuable because they can be obtained regardless of weather and time conditions. However, SAR images have fatal noise and less contextual information, thus making it harder and less interpretable. So, translation of SAR to Electro-Optical (EO) images is highly required for easier interpretation. In this paper, we propose a novel coarse-to-fine context-aware SAR-to-EO image translation (CFCA-SET) framework and a misalignment-resistant loss for the misaligned pairs of SAR-EO images. With our auxiliary learning of SAR-to-Near-Infrared translation, CFCA-SET consists of a two-stage training: (i) the low-resolution SAR-to-EO translation is learned in the coarse stage via a local self-attention module that helps diminish the SAR noise, and (ii) the resulting output is used as guidance in the fine stage to generate the SAR colorization of high resolution. Our proposed auxiliary learning of SAR-to-NIR translation can successfully lead CFCA-SET to learn distinguishable characteristics of various SAR objects with less confusion in a context-aware manner. To handle the inevitable misalignment problem between SAR and EO images, we newly design a misalignment-resistant loss function. Extensive experimental results show that our CFCA-SET can generate more recognizable and understandable EO-like images compared to other methods in terms of nine image quality metrics. Our CFCA-SET surpasses the state-ofthe-art methods for two (QXS and CASET) datasets with the improvements: PSNR (3.6%, 29%), ERGAS (7.4%, 30%), SSIM

(15%, 15%), SAM (21%, 38%), DS (16%, 13%), QNR (1.5%, 3.1%), CHD (18%, 12%), LPIPS (4.2%, 8%), and FID (9.0%, 33%).