227 238, Tesma607, IJEAST
227 238, Tesma607, IJEAST
227
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
using synthetic and real MR image dataset from Kaggle block is individually equalized. So in a small area, a
(name of data set), to detect and classify different types of histogram would confine to a small region.
tumor. However, there are chances of noises being amplified. To
This paper is divided into 6 sections. Section 2 gives us a avoid this problem, we apply contrast limiting. The pixel
literature survey conducted on different methods for a better values above the specified contrast limit are clipped and
understanding of the project. Section 3 describes the then uniformly distributed to other bins before filtering.
methods utilized in this paper. Section 4 provides the An image contains a lot of features like edges, brightness
experimental results over MR images. The conclusions are or contrast, and color. Blurring is a method to process this
given in section 5. Section 6 gives details about the future image. An image looks more sharp and detailed if we can
scope of the paper. perceive all the objects and their shapes correctly. In
Section 2: Methodology blurring, we reduce the content of the edges to transition
from one color to another color very smoothly.
Gaussian filters are fast processing and more effective
II. DATA PREPARATION AND PRE-PROCESSING while smoothening is applied on the images. It might not
Data preparation is a data mining technique that involves preserve image brightness and not particularly effective at
the transformation of raw data to a format that is more removing salt and pepper noise. On the other hand, Median
interpretable and makes the images more suitable for Filters maintain the sharpness of the picture boundaries and
further processing. While preparing the images, we effective in non-linear smoothing. However median filter
lacks in distinguish fine details from the noise. In Bilateral
implemented the technique of crop normalization on MRI
images. This is a technique to find the extreme points in filtering, most of the fine texture is filtered away, and yet
contours. We determined the extreme contours in the input all contours are as crisp as in the original image.
image and outlined the skull. We removed the black
redundant background, without damaging any pixel quality. III. IMAGE SEGMENTATION
The advantage of doing Crop Normalization is that we get
Classically, image segmentation is defined as the
a clear region of interest for further processing and we
partitioning of an image into non-overlapping regions,
remove tags from the MRI without damaging any detail
which are homogeneous with respect to some
from the MRI.
characteristics such as intensity or texture. We have used
The output was as follows:
the following techniques for segmentation of the tumor
We have used Tw1 and Tw2 mixed MRI images of brain
from the MRI images:
tumour. The input dataset contains images with a different
dimension and with different aspect ratios. Therefore, the
A. Active Contours Snakes
images in the dataset are resized to a pre-set format, since
the pre-trained models used require the images to be Active Contours Snakes is a segmentation using curves
200×200 dimensions. and not pixels. Users can define a curve, which will then
FILTERS: evolve.
We have used a variety of filters to smooth out the MRI The evolution of the curve should satisfy two aspects. It
Images. To improve the contrast of the image, we used a should adapt to image edges and it has to be smoothly
Histogram Equalisation filter. An image can have values varying.
confined in a specific range. A brighter image may have all To satisfy this evolution we need to have a measure. This
pixels confined to high values and a dull image may have is parameterized by the energy of the curve. The objective
all pixels confined to low values. However, a good image to satisfy the two aspects is measured by minimizing an
will have pixels from all regions of the image. Hence energy parameter E(c), where c represents the curve under
through adjustment, the intensities can be better distributed evolution.
on the histogram. This method spreads out the most E(c)= Einternal(c) + Eexternal(c)
frequent intensity values, resulting in areas associated with The curve has two aspects. The first is internal to the
lower contrast to gain a higher contrast. Histogram curve which corresponds to the smoothly varying aspect of
equalization normally improves the contrast of the image the curve. This parameter regularizes the curve and makes
Histogram equalization is responsible for increasing the it smooth. It depends on the shape of the curve as we want
global contrast of the image but is more effective only in to minimize the distortions. The second is the external to
images that have close contrast values. the curve that looks for edges. This parameter refers to the
Histogram is not confined to a particular region, so we direction towards which the curve should evolve. External
can lose information due to over brightness. Therefore, to parameter depends on the image intensity.
solve this problem, adaptive histogram equalization is used. Internal Energy:
The image is divided into small 8x8 size blocks and each 1
Einternal(c) = ∫ (𝛼 ∥ 𝑐′(𝑠) ∥2 + 𝛽 ∥ 𝑐′′(𝑠) ∥2 ) 𝑑𝑠
0
228
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
c'(s) and c''(s) are the first and the second derivative of the The second-order derivative ensures that the curve is not
curve respectively. too 'bendy'. If there are irregularities or oscillations in the
α and β are the two hyper parameters which we have curve, then the c'' value will be high. Hence low second-
taken as 0.06 and 0.6 respectively. These values refer to the order derivative prevents points of the curve from
weights we want to locate to the first and second-order oscillating.
derivatives of the curve. We want to minimize the internal energy to as low as
ds indicates that the curve is divided into small segments. possible and to achieve that we should ensure a curve that
The limit 0 to 1 means we are converting the entire segment is smooth with no oscillations.
of the curve. The first-order derivative is anisotropic, and the second-
We define a region of interest i.e. the tumor outlining. As order derivative is isotropic.
1
it is a discrete system, the curve is divided into various Eexternal(c) = ∫0 −∥ ∇𝐼(𝑐(𝑠)) ∥2 𝑑𝑠 =
segments. We define a starting point. 0 to 1 integral limits 1
𝜕𝐼(𝑥(𝑠), 𝑦(𝑠)) 2 𝜕𝐼(𝑥(𝑠), 𝑦(𝑠)) 2
traverse the curve from the start to the endpoint. The small ∫ − [( ) + ( ) ]𝑑𝑠
0 𝜕𝑥 𝜕𝑦
separation is ds. Each of the location division has an x and
y coordinate which is represented by s. Here, I represents the intensity at locations of x(s) and y(s).
The first-order derivative is to keep the curve not too It is obvious that when we have a large edge the intensity
'stretchy'. If the two-division points selected are far apart, difference is also high. Applying a negative sign to a high
then c' value will be very high. Higher value means less
smoothness. Hence, to make it smoother the points chosen
should be closer. Low c' means we are taking closer
samples.
Fig. 2.
229
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
Fig. 3.
magnitude will ensure that the energy is minimum. As the snake Cluster center initialization is done randomly. Any four
moves towards lower energies, it will be attracted towards the points will be randomly selected and be chosen as the center
large edges. of the four clusters we have defined. The Euclidean distance
from each sample point to the center of the cluster is
B. Fuzzy C means calculated using the formula:
Di,j=∑ml=1(xi,l-cj,l)2, 1≤i≤n, 1≤j≤k
There exists a set S={x1,x2.....xn} and any chosen point
xi either belongs or does not belong to this set. Here i and j refer to the sample point and the center
It is an indicator function to determine this possibility. If cluster respectively.
Is is 0, then xi does not belong to S and if Is is 1, then xi Membership function can be defined as the degree to
does belong to S. The set is divided into n number of data which a sample point belongs to a particular cluster. Thus
points, k number of clusters, and m number of numerical points nearer to the cluster center will have a higher degree
attributes. of membership than those towards the edges or further.
Fuzzy set mainly deals with 1's and 0's and all the values in Membership function can be calculated using the following
between them. Fuzzy is unlike crisp sets where membership equation:
values can only take values 0 and 1.
In our project, we have initialized four clusters and Ui,j=1/(∑kl=1(Di,j/Di,j)2/(m-1)) ; 1≤i≤n, 1≤j≤k
chosen a fuzziness factor of 2.
Fig. 4.
230
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
Fig. 5.
Fig. 6.
two sets- S1 with pixel intensities less than or equal to t and
S2 consists of all pixel intensities that are more than t. Mean
of both sets computed: two local threshold values obtained.
231
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
Then the Image is segmented into 4 sets using the three B. Hybrid Snake’s-Enhanced FCM Method
thresholds obtained.
The hybrid Snake’s-Enhanced FCM is Edge Based
g(x,y)= a, when 0 ≤ f(x,y) ≤ m1
Snakes segmentation normalized Enhanced FCM (EnFCM)
=b, when m1 < f(x,y) ≤ thres1
feature extraction which combines Snake’s Tumor
=c, when thres1 < f(x,y) ≤ m2
Segmentation method with EnFCM clustering which is an
=d, when f(x,y)> m2
improved version of traditional Fuzzy C-Means introduced
It is seen that even though the proposed algorithm
by Szilagyi et al. with a filter introduced inside the cyclical
clusters pixels into four regions only, it successfully detects
optimization problem, which led to better image quality.
all of the regions of interest (ROI) specified in the images.
By selecting appropriate values of the intensity levels a, b,
c, and d, different areas of the image can be highlighted and
C. Hybrid Triple Thresholding- Modified FCM Method
object identification can be done. It can be inferred that
region-based triple thresholding fusioned with CLAHE is a The hybrid triple thresholding-Modified FCM or bias-
simple yet efficient thresholding method for the corrected FCM is Region Derived Triple Thresholding
segmentation of grayscale images. normalized Modified FCM(MFCM) feature extraction
which combines Triple Thresholding Segmentation into
IV. FEATURE EXTRACTION
four regions based on intrinsic image characteristics with
MFCM clustering which is modified object function of
A. Hybrid Segmentation standard Fuzzy C-Means algorithm introduced by Ahmed
et al. This compensates for intensity inhomogeneities and
Automatic segmentation of the abnormality from the MR
imaging modalities is a huge concern for the radiologist. In the labelling of a pixel takes the labels in its immediate
the past various distinguished approaches and methods have neighborhood into account. This regularisation results in
been proposed based on different approaches like edge piecewise-homogeneous labelling.
detection, region growing, fuzzy logics, and clustering for
fast and effective segmentation. Edge-based snakes used for
the extraction of the tumor region from brain MR image D. Computer-Aided Detection:
gives satisfactory results but due to weak gradient Features of the brain tumor have been extracted to further
magnitude, the algorithm works effectively well only for improve the efficiency of the classification algorithms in
high contrast images and degrades performance with low detecting the type of tumor. The more processing of MRI
contrast images. The various clustering-based segmentation images along with feature extraction is done, the higher
approaches like k-means, fuzzy clustering works well for accuracy will be shown by the classification models.
the extraction of tumors but as the algorithm was based on To detect & extract features of brain tumors, a model is
randomness so whenever the algorithm runs gives different constructed by combining Convolutional Neural Networks
outputs. To overcome we suggest using Hybrid with MRI detection technology using Computer-aided
Segmentation, a Technique integrating two or more detection technology.
techniques which is efficiently giving better results than the The main function of this model is to segment and recognize
segmentation algorithms working alone. A combination of brain tumors and use a convolutional layer to perform
both thresholding and fuzzy clustering techniques will be convolution operations for improving recognition
considered because thresholding finds out the uniform efficiency & rate and combine artificially selected features
regions for fuzzy clustering, which makes the clustering with machine learning features. Also, feature fusion is used
performance better. In this article, we have proposed two by this mechanism to further improve the diagnostic results.
Hybrid Segmentation techniques for user-defined and
automated segmentation.
Fig. 7.
232
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.
233
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
TABLE I
CASE VALUES FOR VARIOUS TYPES OF TUMORS
TABLE II
BINARY OUTPUTS FOR VARIOUS TYPES OF TUMORS MENTIONED IN THE EXAMPLE SET
235
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
Fig. 14. One hot encoding: Model loss graph for Epoch VS Loss Perfect fit observed for epoch: 19 and batch size: 32
236
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
BEE COLONY OPTIMIZATION WITH FCM," Gulyas, "3D Deep Learning on Medical Images: A
International Conference on Soft-computing and Network Review", Sensors, vol.20, 5097, 2020.
Security (IC- SNS), 2018. doi:10.3390/s20185097
[5] Najlae Idrissi, Beni Mellal, Fatima Ezzahra Ajmi and [11] Justin Ker, Satya P. Singh, Yeqi Bai, Jai Rao,
Beni Mellal, “A Hybrid Segmentation Approach for Brain Tchoyoson Lim and Lipo P. Wang, “Image Thresholding
Tumor Extraction and Detection.” ICMCS' 14, Moroccan Improves 3-Dimensional Convolutional Neural Network
imperial legendary city, Marrakech, April 14-16, 2014. Diagnosis of Different Acute Brain Hemorrhages on
[6] Mutasem K. Alsmadi, “MRI Brain Segmentation Computed Tomography Scans,” Sensors, 2019, 19, 2167,
Using a Hybrid Artifical Bee Colony Algorithm with doi: 10.3390/s19092167
Fuzzy- C Mean Algorithm,“ Journal of Applied Sciences [12] Satya P. Singh, Lipo P. Wang, Sukrit Gupta, Balazs
15(1): 100-109. 2015 ISSN 1812-5654 / DOI: 10 Gulyas, and Parasuraman Padmanabhan, “Shallow 3D
3923/jas.2015.100.109, Asian Network for Scientific CNN for Detecting Acute Brain Hemorrhage from Medical
Information. Imaging Sensors,” IEEE Sensors Journal, 2020.
[7] Ciresan, Dan; Meier, Ueli; Schmidhuber, Jurgen, [13] Justin Ker, Lipo P. Wang, Jai Rao, and Tchoyoson
“Mult- column deep neural networks for image Lim, “Deep Learning Applications in Medical Image
classification,” 2012 IEEE Conference on Computer Vision Analysis”, IEEE Access, vol.6, pp. 9375-9389, 2018.
and Pattern Recognition, pp. 3642-3649. [14] Ross Girshick;, Fast R-CNN, Proceedings of the
[8] Justin Ker, Yeqi Bai, Hwei Yee Lee, Jai Rao, and IEEE International Conference on Computer Vision
Lipo P. Wang, “Automated brain histology classification (ICCV), 2015, pp. 1440-1448
using machine learning,” Journal of Clinical Neuroscience,
vol.66, pp. 239-245, 2019.
[9] Yadav, 8.S., Jadhav, 8.M. Deep convolutional neural
network based medical image classification for disease
diagnosis. J Big Data 6, 113 (2019).
[10] Satya P. Singh, Lipo P. Wang, Sukrit Gupta,
Haveesh Goli, Parasuraman Padmanabhan, and Balazs
Fig. 15. Output for an MRI image tested with the One Hot Encoding model
237
International Journal of Engineering Applied Sciences and Teclogy, 2021
Vol. 6, Issue 7, ISSN No. 2455-2143, Pages 227-238
Published Online November 2021 in IJEAST (http://www.ijeast.com)
Fig. 16. One hot encoding: Model loss graph for Epoch VS Loss. Underfit curve observed for epoch: 4 and batch size 32
Fig. 17. One hot encoding: Model loss graph for Epoch VS Loss. Overfit curve observed for epoch: 30 and batch size: 25
238