High-Resolution Image Reconstruction
High-Resolution Image Reconstruction
E-ISSN 2586-9027
Department of Computer Science and Engineering, JECRC University, Jaipur 303905, India
ABSTRACT
The resolution of images in the medical field plays an important role in taking decisions
to identify diseases, but if the image resolution is low, then disease identification may go
wrong. For the correct decision, the image should be of high-resolution. High-resolution im-
ages can be taken using efficient hardware devices also, but then it is a costly proposition.
Thus, we propose a model to reconstruct a low-resolution image into a high-resolution image
using four image enlarging algorithms and an image enhancement algorithm. Initially, images
are enlarged using enlarging algorithms to generate four images, followed by an image en-
hancement algorithm to generate four enhanced quality images. Thereafter, one high-
resolution composite image is constructed using these four images. Experimental results were
compared with the results of existing image enlarging approaches. Significant improvements
in important image parameters like Peak Signal to Noise Ratio (PSNR), Signal to Noise Ratio
(SNR), Structural similarity (SSIM), and Mean Squared Error (MSE) could be achieved.
Keywords: Composite image; High-resolution image; Image enhancement algorithm; Image
enlargement algorithm
138
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
139
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
The whole process was done in the Step 2: Enhancement of enlarged images
following three phases: using back-projection algorithm
Step 1: Enlarging the low-resolution images Step 3: Finally, enhanced images are
using four different enlargement algorithms. grouped to generate a composite enhanced
final high-resolution image.
Fig. 1. The proposed model to reconstruct a high-resolution image from a low-resolution image.
Next, two images are grouped togeth- List 2. MATLAB code to construct compo-
er to construct a composite image. This site image
grouping of images was done using the im- image-sr-nn = imread(sr_nearest.png');
fuse function of MATLAB. We are group- image-sr-bi = imread('sr_bi_output.png');
ing I5 with I6 and I7 with I8 to generate two image-sr-xbr = imread('sr_xbr.png');
composite images I9 and I10, respectively. image-sr-hqx = imread('sr_hqx.png');
Finally, these two images are grouped to- c=imfuse(image-sr-nn, image-sr-bi);
gether to construct a final enhanced high- d=imfuse(image-sr-xbr, image-sr-hqx);
imwrite(composite-1,'bilinear_plus_nearest.png')
resolution image of 512 x 512. MATLAB
imwrite(composite-2,'xbr_plus_hqx.png')
code for composite image construction is hr-image=imfuse(composite-1, composite-2);
shown in Listing 2 and flow chart is shown imwrite(hr-image, 'final_composite.png')
in Fig. 3
141
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
142
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
(e)
Fig. 4. Input and output images after applying image enlargement algorithms, (a) input image (b) Near-
est Neighbour Interpolation (c) Bilinear Interpolation d) Hqx (e) xBR.
We have used the IBP algorithm to values are shown in Table 2. As compared
improve image quality. The improved imag- to Table 1, the values of parameters have
es are shown in Fig. 5, and new parameter been significantly improved.
143
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
Table 2. Image parameters after applying Iterative Back Projection Algorithm on enlarged
images.
Enhanced-Nearest Enhanced-Bilinear Enhanced-Hqx Enhanced-xBR
Neighbour Interpolation Interpolation
PSNR 21.1759 21.5021 21.2734 21.2586
SNR 11.4989 11.8252 11.5964 11.6217
SSIM 0.6975 0.7232 0.7310 0.7115
MSE 456.0142 460.1153 484.9981 486.6495
Figs. 6a and 6b show the results of The final enhanced composite image,
the composite images. Two composite im- shown in Fig. 6c, is generated using the im-
ages are generated: the first using En- ages received from Fig. 6a and 6b. As is
hanced-Nearest Neighbour Interpolation and evident from Table 3, the PSNR, SNR,
Enhanced-Bilinear Interpolation and the SSIM and MSE values of the final image
second using Enhanced-HQX and En- have better parameter values as compared to
hanced-xBR. Parameter values of composite images obtained after applying the image
images are shown in Table 3. These compo- enlargement algorithm and further after us-
site images have further improved PSNR, ing the IBP algorithm.
SNR, SSIM and MSE.
144
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
Table 4. Comparison of parameters of the image shown in Fig. 7 with methodologies [21] &
[22] and proposed methodology.
Proposed
MIEBF[21] KBIE[22]
Methodology
PSNR 27.0021 27.9658 28.4514
SNR 18.9887 19.5521 19.8822
SSIM 0.8778 0.8696 0.8852
MSE 178.0215 152.2374 200.8541
Furthermore, we applied our method- MSE parameters were improved for most of
ology on 177 knee MRI images of the the images as depicted in Fig. 8.
MRNet [20] and the PSNR, SNR, SSIM and
Fig. 8. Number of images for which PSNR, SNR, SSIM and MSE parameters were improved.
5. Conclusion and Future Work ity of enlarged images, the IBP algorithm
We proposed a methodology to re- has been applied to the enlarged images,
construct an enhanced high-resolution im- followed by the construction of composite
age from the low-resolution medical image. images. Experimental results have shown
We have used four image enlargement algo- that the proposed method has reduced the
rithms. The enlargement algorithms are also noise and enriched the details. The proposed
able to generate a high-resolution image but methodology has resulted in improved im-
may have less detail, so to improve the qual- age parameters, namely PSNR, SNR, SSIM,
145
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
and MSE, in each step. The final high- rithm based on ringing artifacts suppres-
resolution image has significantly improved sion. Neurocomputing. 2015;162:171-9.
the values of the image parameters under
consideration. Our methodology evaluated [8] Yoo J, Kim J. Noise-Robust Iterative
Back-Projection. IEEE Transactions on
the performance of the composite image
Image Processing. 2020;29:1219-32.
before and after the reduction of noise and
blur. In the future, we intend to improve the [9] Zhu J, Zhou C, Fan D, Zhou J. A New
image quality by creating a composite im- Method for Superresolution Image Re-
age using other algorithms so as to experi- construction Based on Surveying Ad-
ment and observe how finer details of the justment. Journal of Nanomaterials.
images can be preserved. Different image 2014;2014:1-6.
enlargement algorithms can also be applied
for experimentation. [10] Sundar K, Vaithiyanathan V. A novel
method for super resolution image recon-
struction. International Journal of Ad-
References vanced Intelligence Paradigms.
[1] Lin H, Lin C, Lin C, Yang S, Yu C. A 2019;14(1/2):46.
Study of Digital Image Enlargement and
Enhancement. Mathematical Problems in [11] Yu C, Lin H, Lin R. Eight-Scale Image
Engineering. 2014; 2014:1-7. Contrast Enhancement Based on Adap-
tive Inverse Hyperbolic Tangent Algo-
[2] Danahy E, Agaian S, Panetta K. Algo- rithm. 2014 International Symposium on
rithms for the resizing of binary and Computer, Consumer and Control. 2014.
grayscale images using a logical trans-
form. Image Processing: Algorithms and [12] Liu M, Huang J, Gao M, Qin S. High
Systems V. 2007. Performance Super-Resolution Recon-
struction of Multiple Images Based on
[3] Kreuzer F, Kopf J, Wimmer M. Depix- Fast Registration and Edge Enhancement.
elizing pixel art in real-time. Proceedings Lecture Notes in Computer Science.
of the 19th Symposium on Interactive 3D 2013;:649-57.
Graphics and Games - i3D '15. 2015.
[13] Tanaka M, Okutomi M. A fast MAP-
[4] Kerautret B, Lachaud J. Geometric Total based super-resolution algorithm for gen-
Variation for Image Vectorization, Zoom- eral motion. Computational Imaging IV.
ing and Pixel Art Depixelizing. Lecture 2006.
Notes in Computer Science. 2020;:391-
405. [14] Li T, Chen H, Zhang M, Liu S, Xia S,
Cao X et al. A new design in iterative im-
[5] Stasik P, Balcerek J. Extensible Imple- age deblurring for improved robustness
mentation of Reliable Pixel Art Interpola- and performance. Pattern Recognition.
tion. Foundations of Computing and De- 2019;90:134-46.
cision Sciences. 2019;44(2):213-39.
[15] Li F, Fraser D, Jia X. Efficient IBP with
[6] Fuentes J, Ruiz J. A deblurring model for super resolution for ALOS imagery.
super-resolution MRI interpolated imag- Geoinformatics 2007: Remotely Sensed
es. 15th International Symposium on Data and Information. 2007.
Medical Information Processing and
Analysis. 2020. [16] Irani M, Peleg S. Improving resolution by
image registration. CVGIP: Graphical
[7] Yang X, Zhang Y, Zhou D, Yang R. An Models and Image Processing.
improved iterative back projection algo- 1991;53(3):231-9.
146
L. Kumar and M. Jain | Science & Technology Asia | Vol.27 No.2 April - June 2022
[17] Purkait P, Chanda B. Super Resolution [20] Bien N, Rajpurkar P, Ball R, Irvin J, Park
Image Reconstruction Through Bregman A, Jones E et al. Deep-learning-assisted
Iteration Using Morphologic Regulariza- diagnosis for knee magnetic resonance
tion. IEEE Transactions on Image Pro- imaging: Development and retrospective
cessing. 2012;21(9):4029-39. validation of MRNet. PLOS Medicine.
2018;15(11):e1002699.
[18] Marcus D, Wang T, Parker J, Csernansky
J, Morris J, Buckner R. Open Access Se- [21] Anoop V, Bipin PR. Medical Image En-
ries of Imaging Studies (OASIS): Cross- hancement by a Bilateral Filter Using Op-
sectional MRI Data in Young, Middle timization Technique. J Med Syst. 2019;
Aged, Nondemented, and Demented Old- 43(8).
er Adults. Journal of Cognitive Neurosci-
ence. 2007;19(9):1498-507. [22] Muslim H, Khan S, Hussain S, Jamal A,
Qasim H.A knowledge-based image en-
[19] Yigit A, Isik Z. Application of artificial hancement and denoising approach.
neural networks in dementia and alzhei- Computational and Mathematical Organ-
mer's diagnosis. 2018 26th Signal Pro- ization Theory. 2018;25(2):108-21.
cessing and Communications Applica-
tions Conference (SIU). 2018.
147