Main Content

NEC and Tokyo Institute of Technology use AI to dramatically increase image clarity under severe conditions

NEC Corporation and Tokyo Institute of Technology (Tokyo Tech) today announced their joint development of a multi-modal image fusion technology that dramatically improves the clarity of images by using artificial intelligence (AI) to automatically combine visible images taken by standard cameras with non-visible images taken by specialized devices, such as thermal or terahertz cameras. In recent years, technological advancements and cost reductions for specialized devices that photograph non-visible images, such as thermal cameras, which capture heat, and X-ray cameras, have enabled them to be used for an expanding range of purposes, including nighttime monitoring under severe weather conditions, such as dense fog (*). However, these cameras tend to provide images of poor resolution and quality in comparison to images taken of visible subjects. Conventionally, in order to analyze non-visible and visible images of the same subject, images had to be viewed and compared separately, or they had to be manually combined by a trained expert. Moreover, the detection of abnormalities or hazards contained in non-visible images could be easily overlooked when combining the images. This new technology uses AI to achieve greater image visibility by automatically selecting highly visible parts from multiple images and combining them, while enhancing the smallest characteristics contained in non-visible images. Specifically, AI carries out detailed examination of each image in order to assess the degree of visibility of each part, then automatically extracts the best areas from each image, taking environmental characteristics into consideration, such as brightness, the direction of light and obstacles.”

Link to article