An Automated System for Skeletal Maturity Assessment by Extreme Learning Machines

Marjan Mansourvar; Shahaboddin Shamshirband; Ram Gopal Raj; Roshan Gunalan; Iman Mazinani

doi:10.1371/journal.pone.0138493

Abstract

Assessing skeletal age is a subjective and tedious examination process. Hence, automated assessment methods have been developed to replace manual evaluation in medical applications. In this study, a new fully automated method based on content-based image retrieval and using extreme learning machines (ELM) is designed and adapted to assess skeletal maturity. The main novelty of this approach is it overcomes the segmentation problem as suffered by existing systems. The estimation results of ELM models are compared with those of genetic programming (GP) and artificial neural networks (ANNs) models. The experimental results signify improvement in assessment accuracy over GP and ANN, while generalization capability is possible with the ELM approach. Moreover, the results are indicated that the ELM model developed can be used confidently in further work on formulating novel models of skeletal age assessment strategies. According to the experimental results, the new presented method has the capacity to learn many hundreds of times faster than traditional learning methods and it has sufficient overall performance in many aspects. It has conclusively been found that applying ELM is particularly promising as an alternative method for evaluating skeletal age.

Citation: Mansourvar M, Shamshirband S, Raj RG, Gunalan R, Mazinani I (2015) An Automated System for Skeletal Maturity Assessment by Extreme Learning Machines. PLoS ONE 10(9): e0138493. https://doi.org/10.1371/journal.pone.0138493

Editor: Zhaohong Deng, Jiangnan University, CHINA

Received: June 6, 2015; Accepted: August 30, 2015; Published: September 24, 2015

Copyright: © 2015 Mansourvar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

Data Availability: Data are collected from Medical Image Research Centre database.

Funding: University of Malaya Research Grant (UMRG), grant number. RP026-14AET.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Skeletal maturity assessment, or bone age assessment (BAA), is a radiological process to examine the ossification development in the left-hand wrist and estimate the bone’s age by making comparisons with an atlas comprising hundreds of standard images [1]. Many disease in children such as growth disorders, chromosomal disorders, endocrine disorders and endocrinological problems could be discovered by the discrepancy between the bone age and chronological age. Bone age assessment is an important process in clinical routine; however, it has not improved much over the last 35 years [2,3]. There are two well-known methods applied for BAA: the Greulich-Pyle (GP) [4] and Tanner-Whitehouse (TW2) methods [5]. In the GP system, radiologists compare hand bone radiographs with standardized radiographs from the atlas and make evaluations, while the TW2 system is based on a scoring method [6]. The results from both these assessment types are associated with human observation variability, since a radiologist doing a bone age assessment to evaluate a child’s maturation cannot be certain about estimation accuracy [7,8]. Therefore, this has been the greatest motivator for presenting an automated method of estimating skeletal maturity (bone age)[9]. However, the computerized BAA system is still under the empirical period because of the inadequate performance of the system [10]. Some proposed methods have been discussed in the literature.

State of art

The first try to design an automated system for bone age assessment have been reported by Nelson and Micheal, in 1989 [11]. Their system converted the images to the binary format and normalized the image before processing. This system have been never evaluated in a large scale due to the some drawback in overlapping of pixel intensity of bone in image processing technique. Manos with his team posed segmentation and presented a method for merging region and edge detection in pre-processing level [12]. However, the output of edge detection was not reliable and threshold was included the results. Pietka et al. [13] have designed a method based on analysis of carpal bone in hand-wrist. The system used dilation method to extract the carpal. Their research team improved the system by windowing technique to calculate the statistical features. However the new version of system still doesn’t find the solution for the segmentation problem. Another system was reported by Mahmoodi, has applied the binary thresholding and location searching using concave-convex followed by segmentation based on the active shape technique [14]. Sebastian et al. [15] has conducted a study on image segmentation base on deformable method, the pre-processing contained the region growing and local competition in region sections. The output of this system was acceptable but it was included the heavy computing processes and complicated calculating. In the system presented by Gertych et al. [16] adaptive segmentation technique was applied based on Gibbs random in the pre-processing stage. Zhang et al. [17] worked on the carpal segmentation using the anisotropic diffusion and adaptive image threshold in the pre-processing stage. The proposed included canny edge detection that is not robust technique in image segmentation. Han et al. [18] presented Gradient vector flow (GVF) to use the segmentation while this technique was involved heavy loading process for edge detection. Liue et al. [19] suggested primitive image processing method that is similar to edge detection and simulate matching at the pre-processing level of segmentation. Most of the method is presented to the model for segmentation of the hand, however estimation of bone age according this method was never assess accurately. Hence, this method cannot be introduced as a fully automated system for bone age assessment.

Bone age analysis requires high accuracy for assessment. The aim of this study is to introduce a new model of determining bone age based on content-based image retrieval (CBIR) technique as a part of a novel age assessment method, using a soft computing approach, namely extreme learning machines (ELM) for evaluation, which is a 100% automated method for BAA. Nowadays, applying modern computational approaches to solving real problems and determining optimal values and functions has been receiving enormous attention from researchers in diverse scientific disciplines [20]. Neural networks (NN), a vital computational approach, has recently been introduced and applied in various engineering areas such as medical application diagnosis [21,22]. This method facilitates solving complex nonlinear problems, which are otherwise difficult to solve with classic parametric methods. There are numerous algorithms for training neural networks, such as hidden Markov model (HMM), back propagation, and the support vector machines (SVM). A shortcoming of NN is learning time application. Huang et al. [23] introduced an approach for single-layer feed forward NN known as Extreme Learning Machines (ELM). This technique is capable to solve the problems are creating by gradient descent-based algorithms like backpropagation in ANNs. ELM can decrease the required time for training a Neural Network. In fact, it has been proven that by using ELM, the learning process becomes very fast and generates robust performance [24]. Accordingly, a number of investigations have been carried out related to the successful application of the ELM algorithm in solving problems in various scientific fields [25–30].

In general, ELM is a powerful algorithm with faster learning speed than traditional algorithms like backpropagation (BP) and superior performance. ELM attempts to achieve the standard of weights with the smallest error rate of training.

In this study, a new automated bone age assessment approach is developed and evaluated by the ELM measurement and elimination the need for image segmentation. The results indicate that the proposed model can adequately estimate skeletal age. The ELM results are also compared with the results from genetic programing (GP) and artificial neural networks (ANNs). An attempt is made to retrieve the correlation between chronological age and bone age.

Methodology

The Content-based image retrieval (CBIR) approach is become famous in medical imaging as well as crime prevention in recent years [31]. The CBIR system was developed in the 1990s to solve problems encountered in text-based image retrieval. The CBIR method is based on querying by image [32]. Content-based image retrieval is a robust method to determine age independent of bone measurements. The CBIR methodology for skeletal age assessment is involves comparing image content for a new input with earlier samples. Most BAA systems are applied to the regions of interest (ROIs) in hand bones, which leads to low accuracy in bone age assessment [17,33,34]. The new method utilized in our study overcomes the mentioned limitation in literature by using complete images for an individual query instead of applying the query to the regions of interest (ROIs) [35]. The CBIR assessment methodology is found on compressing image content from a new sample with the earlier samples. Fig 1 shows the CBIR layout applied in our BAA system.

Download:

Fig 1. CBIR layout in the bone age assessment system.

https://doi.org/10.1371/journal.pone.0138493.g001

In our system, not only are whole images considered, but so is visual content information such as ethnicity and gender, since these features allow the system to correctly perform extractions from the available data. The feature extraction includes getting the related features from images. Therefore, the features are extracted from the hand radiographs, and an optimal subset of the selected features is picked. Feature extraction is based on the Weighted PCA as it is one of the best pattern recognition methods in computer vision applications [36]. It is certainly the most suitable feature extraction method for this study as it is a linear feature extraction technique [37] that is both efficient and fast. The retrieval images in this research included third party data provided from the database in Medical Image Research Centre (IRMA) available at “https://ganymed.imib.rwth-aachen.de/irma/institute_irmadaten.php”. There are 1100 X-rays classified as female and male, and four ethnicities: Asian, Caucasian, African/American and Hispanic [38].

Age assessment

The main step in implementing our BAA system is the process of estimating bone age according to the automated technique (Fig 2). Bone age is assessed by comparing a radiograph with samples from a repository that contains various ages for both genders and four different ethnicities. A temporary repository is needed to rank the retrieved radiographs. The tagged age values of the retrieved images are utilized as part of the BAA process and the final estimated age is calculated as the mean of the retrieved values:

Predicted Bone Age =

Where x = Age of highest ranked retrieved images

n = Total number of highest ranked retrieved images

Download:

Fig 2. Bone age result displayed with the gender and ethnicity features.

https://doi.org/10.1371/journal.pone.0138493.g002

Therefore, bone age assessment is computed in the following steps:

Related features are extracted and stored in the database for a temporary period.
An individual query is enforced to the system’s search engine by each feature.
The best matching output is retrieved from the feature repository according the similarity score for the query.

Validation Experiments

The image data used for the evaluation consists of images collected from normal samples. The age range of the images is 1–18 years for both genders, male and female. The radiographs are classified and scanned in X-ray format with 256 x 260 pixel size. Tables 1 and 2 illustrate the input variables and output results used to validate our system in terms of definition and obtained values.

Download:

Table 1. Category numbers of samples used for evaluation.

https://doi.org/10.1371/journal.pone.0138493.t001

Download:

Table 2. Evaluation of the BAA system based on the comparison with chronological age.

https://doi.org/10.1371/journal.pone.0138493.t002

Extreme Learning Machines (ELM)

Huang at el. [23] introduced the extreme learning machine (also called ELM) according the single-layer feed-forward neural network (SLFN) structure as a tool for learning algorithms [39,40]. The ELM solved the problems like improper learning rate, local minima, and over fitting commonly in iterative learning approaches [41]. ELM selects the input weights randomly and decides the output weights of SLFN analytically. ELM includes a more favourable general capability with faster learning speed. This algorithm does not require much human intervention and can execute much faster than other customary algorithms. The ELM algorithm is able to analytically specify all network variables that prevent human intervention. ELM is an effective technique with numerous advantages including high performance, ease of use, rapid learning speed, kernel functions and suitability for nonlinear activation.

Single hidden layer feed-forward neural network (SLFN).

SLFN structures include L hidden nodes which are usually applied like a mathematical theory of SLFN, combination of the two additives and RBF hidden nodes in an integrated way [42,43]: (1)

In the Eq (1) the learning variables of the hidden nodes indicated by a_i and b_i respectively; the weight joining that presented by β_i is the ith hidden node toward the output node; and the output value of the ith hidden node in related to the input x is G(a_i, b_i, x). The additive structure g(x): R → R (e.g., sigmoid and threshold), G(a_i, b_i, x) by the activation, hidden node is: (2) where a_i represents the vector of the weight that connects the input layout to the ith hidden node; b_i is the basis of the ith hidden node a_i; x is the inner vector result a_i and x in Rⁿ. G(a_i, b_i, x) can be found for the RBF hidden node with the activation structure g(x): R → R (e.g., Gaussian), G(a_i, b_i, x) as [39]: (3)

Since a_i and b_i demonstrate the centre as well as the impact factor of the ith RBF node. The series of all positive real parameters presented by R⁺. In addition, the RBF network considers as a particular case of SLFN with RBF nodes in its hidden layer. For N arbitrary distinct samples (x_i, t_i) ∈ Rⁿ × R^m, x_i is the n × 1 input vector and t_i is the m × 1 target vector. While an SLFN with L hidden nodes could be predict these N samples with zero error, it suggests there exist β_i, a_i and b_i like as [39]: (4)

Eq (4) could be computed compactly as: (5)

Where (6) with (7)

Where H is the hidden level of result matrix of SLFN with the ith column of H being the ith hidden node’s output related to inputs x₁,…, x_N.

Principles of ELM.

Recently, the application of ELM have been extensively studied in different research domains especially in biomedical engineering. ELM has three bold features from learning efficiently point of view: high learning accuracy, fast learning speed and least human invention. The benefit of ELM in generalization over traditional algorithms has been proved for the problems from various areas [44]. The algorithms introduced in neural networks do not included the generalization efficiency when they are applied for the first time. While, ELM reached the better generalization efficiency by the smallest training error rate. It was for this reason that we used ELM as it had the best chance to provide us with improved results.

ELM was defined as a SLFN by L hidden neurons is able to learn L distinct samples which has zero error [27]. Even with the number of hidden neurons (L) is less than the number of distinct cases (N), ELM can still assign random parameters to the hidden nodes and compute the output weights by the pseudo inverse of H, with only a small error of ε > 0. The hidden node variables of ELM a_i and b_i can easily be adjusted random parameters and also they should not be tuned throughout training. These notions will be defined in the following theorems:

Theorem 1: Let there be an SLFN with L additive or RBF hidden nodes and an activation structure g(x) that is extremely differentiable in all interval of R. Furthermore, for arbitrary L definite input variables {x_i | x_i ∈ Rⁿ, i = 1,…, L} and randomly created by all continuous possibility distribution, respectively, the hidden layer output matrix is invertible with the probabilities of one, and the hidden layer output matrix H of the SLFN is invertible and ‖Hβ−T‖ = 0.

Theorem 2: (Liang et al. [34]) Assigning the small positive rate of ε > 0 and activation operation g(x): R → R, that is considerably differentiable in any interval, presently there is existent L ≤ N like that for N arbitrary distinct input vectors {x_i | x_i ∈ Rⁿ, i = 1,…, L} for each randomly produced based upon any continuing potential distribution ‖H_N×Lβ_L×m − T_N×m‖ < ε with a probability of one.

As the hidden node variables of ELM cannot be adjusted throughout training since, they are allocated with random parameters, Eq (5) becomes a linear algorithm and the output weights should be appraised like the following [39]: (8)

Since H⁺ indicated the Moore-Penrose generalized inverse [45] of the hidden level output matrix H which could be computed with many approaches containing orthogonal projection, orthogonalization, iteration, singular value decomposition (SVD), etc. [45]. The orthogonal projection technique is utilized only when H^TT is non-singular and H⁺ = (H^TT)⁻¹ H^T. Owing to the presence of searching and iterations, orthogonalization and iteration methods are included limitations. Implementations of ELM are based on SVD to compute the Moore-Penrose generalized inverse of H, because it can be used in all positions. Hence, ELM is considered a batch learning method.

Artificial neural networks

The backpropagation learning algorithm in the multilayer feedforward network presented the famous neural network structures [46], it is widely used in different scientific fields [47]. Ordinarily, a neural system contains of three levels: (i) an input level; (ii) a middle or hidden level; and (iii) an output level. The first directions are D = (X₁, X₂, …, X_n)^T and D ∈ Rⁿ; the outputs of q neurons in the hidden level are presented by Z = (Z₁, Z₂, …, Z_n)^T; and finally the results of the output level include the Y ∈ R^m, Y = (Y₁, Y₂, …, Y_n)^T. Adopting the tolerance among the input and hidden levels and also the weight are shown by w_ij and y_j respectively and the weight and assuming thorough the hidden and output layers are presented by w_jk and y_k respectively, furthermore the outputs of any neuron in a hidden level and also output level are represented as following: (9) (10)

Since f is applied as transfer function, is included the rule for planning the neuron’s summed input to its output, using a proper instrument for providing non-linearity to the network system. The sigmoid function represents a major function that is monotonic improving and changing from zero to one.

Genetic programming

Genetic programming, or GP, is a progressive method containing Darwinian principles about natural parameters and survival to predict statement in symbol style. GP programming defines how the outputs relate to the input variables. This technique utilizes a basic sample of randomly generated programs (equations) extracted from a random mix of input values, functions and random numbers including arithmetic operators, comparison/logical functions and mathematical functions, which must be selected according to understanding of the process properly. Some solutions are exposed to the evolutionary procedure and the ‘fitness’ of the developed programs is examined. Particular programs with the best data fit are then picked up from the basic population sample. The structures that are the best matches choose to change some of the data among themselves to create better structures from ‘mutation’ and ‘crossover,’ which imitate the reproduction process in the natural world. In the genetic algorithm, mutation means exchanging programs randomly to make new structures, and crossover refers to the changing sections of the best programs with each other. This development routine repeat over successive generations and drive towards searching data for symbolic expressions that could be scientifically clarified to derive procedure information. GP provided a big improvement in the computer science, chemistry, bioinformatics, engineering and mathematics by the metaheuristic (called search heuristic) technique [48–50].

Results

Proposed model accuracy evaluation

The performance of the proposed models is represented as root mean square error (RMSE), coefficient of determination (R²) and the Pearson coefficient (r). These statistics are defined as follows:

root-mean-square error (RMSE)

(11)

Pearson correlation coefficient (r)

(12)

coefficient of determination (R²)

(13)

While O_i and also P_i are the assessed value of bone age and the experiential, accordingly, further more n refers to the total amount of tested data.

Performance evaluation of the proposed ELM model

This section reports the results of the ELM bone age assessment models. Fig 3A shows the accuracy of the presented ELM BAA model. Subsequently, Fig 3B and 3C present the accuracy of the GP and ANN BAA models, respectively. It can be seen that most of the points fall along the diagonal line for the ELM assessment model. Consequently, the estimation results are in very good agreement with the measured values for the ELM model. This observation is supported by the very high coefficient of determination value. The number of either overestimated or underestimated values produced is limited. Thus, it is obvious that the estimated values exhibit high precision levels. Fig 4 shows the comparisons of error rates for the three soft computing models used in this study.

Download:

Fig 3. Scatter plots of actual and estimated bone age values using (a) ELM, (b) GP and (c) ANN.

https://doi.org/10.1371/journal.pone.0138493.g003

Download:

Fig 4. Comparison of error rate for the soft computing models.

https://doi.org/10.1371/journal.pone.0138493.g004

Architecture of soft computing models

The parameters of the ELM, ANN and GP modelling frameworks employed in this study are presented in Table 3.

Download:

Table 3. User-defined parameters for the ELM, ANN and GP models.

https://doi.org/10.1371/journal.pone.0138493.t003

Discussion

Performance comparison of ELM, ANN and GP

To demonstrate the merits of the presented ELM approach on a more definite and tangible basis, the accuracy of ELM model estimation was compared with the accuracy of estimation of the GP and ANN methods, which served as a benchmark. Conventional error statistical indicators, i.e., RMSE, r and R², were used for comparison. Table 4. summarizes the results of estimation accuracy for the test datasets, since training error is not a credible indicator of the prediction potential of a particular model.

Download:

Table 4. Comparison of performance statistics of the ELM, ANN and GP bone age assessment models.

https://doi.org/10.1371/journal.pone.0138493.t004

The ELM model outperformed the GP and ANN models according to the results in Table 4. The ELM model provided significantly better results than the benchmark models. According to RMSE analysis in comparison with ANN and GP, it may be concluded that the proposed ELM outperformed the benchmark models. As ELM is a data driven algorithm, the primary limitation of our method is that it is heavily reliant on the data selection process.

Conclusion

In this study, a systematic approach was carried out to create a new fully automated method to assess bone age using an ELM model, in depended to image segmentation. The ELM measurement was compared with GP and ANN in order to evaluate the models’ accuracy. The results calculated in terms of RMSE, r and R², indicate that the ELM approach is superior to GP and ANN. Furthermore, the results revealed the robustness of the method.

The proposed system has many appealing, remarkable features that distinguish it from conventional, well-known gradient-based learning approaches for feedforward neural networks. ELM approach has much faster learning speed compared to traditional feedforward network learning algorithms such as backpropagation (BP). Moreover, unlike traditional learning algorithms, ELM is able to attain the standard of weights as well as the smallest training error. Future work will involve further improving the skeletal age assessment accuracy by expanding the database of images.

Acknowledgments

This research is supported by the UMRG program, grant no. RP026-14AET, University of Malaya.

Author Contributions

Conceived and designed the experiments: MM. Performed the experiments: MM IM. Analyzed the data: MM SS. Contributed reagents/materials/analysis tools: MM SS RG. Wrote the paper: MM SS RGR. Proofreading: MM RGR.

References

1. Mansourvar M, Ismail MA, Raj RG, Kareem SA, Aik S, Gunalan R, et al. (2014) The applicability of Greulich and Pyle atlas to assess skeletal age for four ethnic groups. Journal of forensic and legal medicine 22: 26–29. pmid:24485416
- View Article
- PubMed/NCBI
- Google Scholar
2. Chai HY, Wee LK, Swee TT, Salleh S-H, Chia L (2011) An artifacts removal post-processing for epiphyseal region-of-interest (EROI) localization in automated bone age assessment (BAA). Biomed Eng Online 10: 87. pmid:21952080
- View Article
- PubMed/NCBI
- Google Scholar
3. Aja-Fernández S, de Luis-Garcıa R, Martın-Fernández MA, Alberola-López C (2004) A computational TW3 classifier for skeletal maturity assessment. A computing with words approach. Journal of Biomedical Informatics 37: 99–107. pmid:15120656
- View Article
- PubMed/NCBI
- Google Scholar
4. Patil ST, Parchand M, Meshram M, Kamdi N (2012) Applicability of Greulich and Pyle skeletal age standards to Indian children. Forensic science international 216: 200. e201–200. e204.
- View Article
- Google Scholar
5. Bull R, Edwards P, Kemp P, Fry S, Hughes I (1999) Bone age assessment: a large scale comparison of the Greulich and Pyle, and Tanner and Whitehouse (TW2) methods. Archives of disease in childhood 81: 172–173. pmid:10490531
- View Article
- PubMed/NCBI
- Google Scholar
6. Mansourvar M, Ismail MA, Herawan T, Gopal Raj R, Abdul Kareem S, Nasaruddin F H, et al. (2013) Automated Bone Age Assessment: Motivation, Taxonomies, and Challenges. Computational and mathematical methods in medicine 2013.
- View Article
- Google Scholar
7. Chai HY, Wee LK, Swee TT, Salleh S-H (2011) Adaptive Crossed Reconstructed (ACR) K-mean Clustering Segmentation for Computer-aided Bone Age Assessment System. International Journal of Mathematical Models and Methods in Applied Sciences 5: 628–635.
- View Article
- Google Scholar
8. Giordano D, Spampinato C, Scarciofalo G, Leonardi R (2010) An automatic system for skeletal bone age measurement by robust processing of carpal and epiphysial/metaphysial bones. Instrumentation and Measurement, IEEE Transactions on 59: 2539–2553.
- View Article
- Google Scholar
9. Mansourvar M, Ismail MA, Kareem SA, Nasaruddin FH, Raj RG. A Quantitative Study for Developing a Computerized System for Bone Age Assessment in University of Malaya Medical Center; 2014. Springer. pp. 659–666.
10. Jonsson K (2002) Fundamentals of hand and wrist imaging. Acta Radiologica 43: 236–236.
- View Article
- Google Scholar
11. Michael DJ, Nelson AC (1989) HANDX: a model-based system for automatic segmentation of bones from digital hand radiographs. Medical Imaging, IEEE Transactions on 8: 64–69.
- View Article
- Google Scholar
12. Manos G, Cairns A, Ricketts IW, Sinclair D (1993) Automatic segmentation of hand-wrist radiographs. Image and vision computing 11: 100–111.
- View Article
- Google Scholar
13. Pietka E, Kaabi L, Kuo M, Huang H (1993) Feature extraction in carpal-bone analysis. Medical Imaging, IEEE Transactions on 12: 44–49.
- View Article
- Google Scholar
14. Mahmoodi S, Sharif BS, Chester EG, Owen JP, Lee R (2000) Skeletal growth estimation using radiographic image processing and analysis. Information Technology in Biomedicine, IEEE Transactions on 4: 292–297.
- View Article
- Google Scholar
15. Sebastian TB, Tek H, Crisco JJ, Kimia BB (2003) Segmentation of carpal bones from CT images using skeletally coupled deformable models. Medical Image Analysis 7: 21–45. pmid:12467720
- View Article
- PubMed/NCBI
- Google Scholar
16. Gertych A, Piętka E, Liu BJ (2007) Segmentation of regions of interest and post-segmentation edge location improvement in computer-aided bone age assessment. Pattern analysis and applications 10: 115–123.
- View Article
- Google Scholar
17. Zhang A, Gertych A, Liu BJ (2007) Automatic bone age assessment for young children from newborn to 7-year-old using carpal bones. Computerized Medical Imaging and Graphics 31: 299–310. pmid:17369018
- View Article
- PubMed/NCBI
- Google Scholar
18. Han C-C, Lee C-H, Peng W-L (2007) Hand radiograph image segmentation using a coarse-to-fine strategy. Pattern Recognition 40: 2994–3004.
- View Article
- Google Scholar
19. Liu J, Qi J, Liu Z, Ning Q, Luo X (2008) Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method. Computerized Medical Imaging and Graphics 32: 678–684. pmid:18835130
- View Article
- PubMed/NCBI
- Google Scholar
20. Yazdani S, Yusof R, Riazi A, Karimian A (2014) Magnetic resonance image tissue classification using an automatic method. Diagnostic pathology 9: 207. pmid:25540017
- View Article
- PubMed/NCBI
- Google Scholar
21. Deng Z, Cao L, Jiang Y, Wang S (2014) Minimax probability TSK fuzzy system classifier: a more transparent and highly interpretable classification model.
- View Article
- Google Scholar
22. Amato F, Lopez A, Peña-Méndez EM, Vaňhara P, Hampl A, Havel J, et al. (2013) Artificial neural networks in medical diagnosis. Journal of applied biomedicine 11: 47–58.
- View Article
- Google Scholar
23. Huang G-B, Zhu Q-Y, Siew C-K. Extreme learning machine: a new learning scheme of feedforward neural networks; 2004. IEEE. pp. 985–990.
24. Huang G-B, Zhu Q-Y, Siew C-K (2006) Real-time learning capability of neural networks. Neural Networks, IEEE Transactions on 17: 863–878.
- View Article
- Google Scholar
25. Yu Q, Miche Y, Séverin E, Lendasse A (2014) Bankruptcy prediction using extreme learning machine and financial expertise. Neurocomputing 128: 296–302.
- View Article
- Google Scholar
26. Wang X, Han M (2014) Online sequential extreme learning machine with kernels for nonstationary time series prediction. Neurocomputing 145: 90–97.
- View Article
- Google Scholar
27. Ghouti L, Sheltami TR, Alutaibi KS (2013) Mobility prediction in mobile ad hoc networks using extreme learning machines. Procedia Computer Science 19: 305–312.
- View Article
- Google Scholar
28. Wang DD, Wang R, Yan H (2014) Fast prediction of protein–protein interaction sites based on Extreme Learning Machines. Neurocomputing 128: 258–266.
- View Article
- Google Scholar
29. Nian R, He B, Zheng B, Van Heeswijk M, Yu Q, Yoan M, et al. (2014) Extreme learning machine towards dynamic model hypothesis in fish ethology research. Neurocomputing 128: 273–284.
- View Article
- Google Scholar
30. Wong PK, Wong KI, Vong CM, Cheung CS (2015) Modeling and optimization of biodiesel engine performance using kernel-based extreme learning machine and cuckoo search. Renewable Energy 74: 640–647.
- View Article
- Google Scholar
31. Mansourvar M, Ismail MA (2014) Content-Based Image Retrieval (CBIR) in Medical Systems. International Journal of Information Technology 20.
- View Article
- Google Scholar
32. Choras RS (2007) Image feature extraction techniques and their applications for CBIR and biometrics systems. International journal of biology and biomedical engineering 1: 6–16.
- View Article
- Google Scholar
33. Tristan-Vega A, Arribas JI (2008) A radius and ulna TW3 bone age assessment system. Biomedical Engineering, IEEE Transactions on 55: 1463–1476.
- View Article
- Google Scholar
34. Fischer B, Welter P, Günther RW, Deserno TM (2012) Web-based bone age assessment by content-based image retrieval for case-based reasoning. International journal of computer assisted radiology and surgery 7: 389–399. pmid:21671096
- View Article
- PubMed/NCBI
- Google Scholar
35. Mansourvar M, Raj RG, Ismail MA, Kareem SA, Shanmugam S, Shahrom W, et al. (2012) Automated Web Based System For Bone Age Assessment Using Historam Technique. Malaysian Journal of Computer Science 25: 107.
- View Article
- Google Scholar
36. Zhan Y, Yin J (2011) Robust local tangent space alignment via iterative weighted PCA. Neurocomputing 74: 1985–1993.
- View Article
- Google Scholar
37. Takekawa T, Isomura Y, Fukai T (2012) Spike sorting of heterogeneous neuron types by multimodality-weighted PCA and explicit robust variational Bayes. Frontiers in neuroinformatics 6.
- View Article
- Google Scholar
38. Fischer B, Welter P, Grouls C, Günther RW, Deserno TM. Bone age assessment by content-based image retrieval and case-based reasoning; 2011. International Society for Optics and Photonics. pp. 79630P-79630P-79610.
39. Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70: 489–501.
- View Article
- Google Scholar
40. Annema A, Hoen K, Wallinga H (1994) Precision requirements for single-layer feedforward neural networks.
- View Article
- Google Scholar
41. Zhang R, Huang G-B, Sundararajan N, Saratchandran P (2007) Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) 4: 485–495.
- View Article
- Google Scholar
42. Huang G-B, Chen L, Siew C-K (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. Neural Networks, IEEE Transactions on 17: 879–892.
- View Article
- Google Scholar
43. Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. Neural Networks, IEEE Transactions on 17: 1411–1423.
- View Article
- Google Scholar
44. Huang G, Huang G-B, Song S, You K (2015) Trends in extreme learning machines: A review. Neural Networks 61: 32–48. pmid:25462632
- View Article
- PubMed/NCBI
- Google Scholar
45. Singh R, Balasundaram S (2007) Application of extreme learning machine method for time series analysis. International Journal of Intelligent Technology 2: 256–262.
- View Article
- Google Scholar
46. Hopfield JJ (1988) Artificial neural networks. Circuits and Devices Magazine, IEEE 4: 3–10.
- View Article
- Google Scholar
47. Drew PJ, Monson JR (2000) Artificial neural networks. Surgery 127: 3–11. pmid:10660751
- View Article
- PubMed/NCBI
- Google Scholar
48. Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection: MIT press.
49. Babovic V, Keijzer M (2005) Rainfall‐Runoff Modeling Based on Genetic Programming. Encyclopedia of Hydrological Sciences.
- View Article
- Google Scholar
50. Khu ST, Liong SY, Babovic V, Madsen H, Muttil N (2001) Genetic Programming And Its Application In Real‐Time Runoff Forecasting1. JAWRA Journal of the American Water Resources Association 37: 439–451.
- View Article
- Google Scholar

[ref1] 1. Mansourvar M, Ismail MA, Raj RG, Kareem SA, Aik S, Gunalan R, et al. (2014) The applicability of Greulich and Pyle atlas to assess skeletal age for four ethnic groups. Journal of forensic and legal medicine 22: 26–29. pmid:24485416
View Article
PubMed/NCBI
Google Scholar

[2] View Article

[3] PubMed/NCBI

[4] Google Scholar

[ref2] 2. Chai HY, Wee LK, Swee TT, Salleh S-H, Chia L (2011) An artifacts removal post-processing for epiphyseal region-of-interest (EROI) localization in automated bone age assessment (BAA). Biomed Eng Online 10: 87. pmid:21952080
View Article
PubMed/NCBI
Google Scholar

[6] View Article

[7] PubMed/NCBI

[8] Google Scholar

[ref3] 3. Aja-Fernández S, de Luis-Garcıa R, Martın-Fernández MA, Alberola-López C (2004) A computational TW3 classifier for skeletal maturity assessment. A computing with words approach. Journal of Biomedical Informatics 37: 99–107. pmid:15120656
View Article
PubMed/NCBI
Google Scholar

[10] View Article

[11] PubMed/NCBI

[12] Google Scholar

[ref4] 4. Patil ST, Parchand M, Meshram M, Kamdi N (2012) Applicability of Greulich and Pyle skeletal age standards to Indian children. Forensic science international 216: 200. e201–200. e204.
View Article
Google Scholar

[14] View Article

[15] Google Scholar

[ref5] 5. Bull R, Edwards P, Kemp P, Fry S, Hughes I (1999) Bone age assessment: a large scale comparison of the Greulich and Pyle, and Tanner and Whitehouse (TW2) methods. Archives of disease in childhood 81: 172–173. pmid:10490531
View Article
PubMed/NCBI
Google Scholar

[17] View Article

[18] PubMed/NCBI

[19] Google Scholar

[ref6] 6. Mansourvar M, Ismail MA, Herawan T, Gopal Raj R, Abdul Kareem S, Nasaruddin F H, et al. (2013) Automated Bone Age Assessment: Motivation, Taxonomies, and Challenges. Computational and mathematical methods in medicine 2013.
View Article
Google Scholar

[21] View Article

[22] Google Scholar

[ref7] 7. Chai HY, Wee LK, Swee TT, Salleh S-H (2011) Adaptive Crossed Reconstructed (ACR) K-mean Clustering Segmentation for Computer-aided Bone Age Assessment System. International Journal of Mathematical Models and Methods in Applied Sciences 5: 628–635.
View Article
Google Scholar

[24] View Article

[25] Google Scholar

[ref8] 8. Giordano D, Spampinato C, Scarciofalo G, Leonardi R (2010) An automatic system for skeletal bone age measurement by robust processing of carpal and epiphysial/metaphysial bones. Instrumentation and Measurement, IEEE Transactions on 59: 2539–2553.
View Article
Google Scholar

[27] View Article

[28] Google Scholar

[ref9] 9. Mansourvar M, Ismail MA, Kareem SA, Nasaruddin FH, Raj RG. A Quantitative Study for Developing a Computerized System for Bone Age Assessment in University of Malaya Medical Center; 2014. Springer. pp. 659–666.

[ref10] 10. Jonsson K (2002) Fundamentals of hand and wrist imaging. Acta Radiologica 43: 236–236.
View Article
Google Scholar

[31] View Article

[32] Google Scholar

[ref11] 11. Michael DJ, Nelson AC (1989) HANDX: a model-based system for automatic segmentation of bones from digital hand radiographs. Medical Imaging, IEEE Transactions on 8: 64–69.
View Article
Google Scholar

[34] View Article

[35] Google Scholar

[ref12] 12. Manos G, Cairns A, Ricketts IW, Sinclair D (1993) Automatic segmentation of hand-wrist radiographs. Image and vision computing 11: 100–111.
View Article
Google Scholar

[37] View Article

[38] Google Scholar

[ref13] 13. Pietka E, Kaabi L, Kuo M, Huang H (1993) Feature extraction in carpal-bone analysis. Medical Imaging, IEEE Transactions on 12: 44–49.
View Article
Google Scholar

[40] View Article

[41] Google Scholar

[ref14] 14. Mahmoodi S, Sharif BS, Chester EG, Owen JP, Lee R (2000) Skeletal growth estimation using radiographic image processing and analysis. Information Technology in Biomedicine, IEEE Transactions on 4: 292–297.
View Article
Google Scholar

[43] View Article

[44] Google Scholar

[ref15] 15. Sebastian TB, Tek H, Crisco JJ, Kimia BB (2003) Segmentation of carpal bones from CT images using skeletally coupled deformable models. Medical Image Analysis 7: 21–45. pmid:12467720
View Article
PubMed/NCBI
Google Scholar

[46] View Article

[47] PubMed/NCBI

[48] Google Scholar

[ref16] 16. Gertych A, Piętka E, Liu BJ (2007) Segmentation of regions of interest and post-segmentation edge location improvement in computer-aided bone age assessment. Pattern analysis and applications 10: 115–123.
View Article
Google Scholar

[50] View Article

[51] Google Scholar

[ref17] 17. Zhang A, Gertych A, Liu BJ (2007) Automatic bone age assessment for young children from newborn to 7-year-old using carpal bones. Computerized Medical Imaging and Graphics 31: 299–310. pmid:17369018
View Article
PubMed/NCBI
Google Scholar

[53] View Article

[54] PubMed/NCBI

[55] Google Scholar

[ref18] 18. Han C-C, Lee C-H, Peng W-L (2007) Hand radiograph image segmentation using a coarse-to-fine strategy. Pattern Recognition 40: 2994–3004.
View Article
Google Scholar

[57] View Article

[58] Google Scholar

[ref19] 19. Liu J, Qi J, Liu Z, Ning Q, Luo X (2008) Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method. Computerized Medical Imaging and Graphics 32: 678–684. pmid:18835130
View Article
PubMed/NCBI
Google Scholar

[60] View Article

[61] PubMed/NCBI

[62] Google Scholar

[ref20] 20. Yazdani S, Yusof R, Riazi A, Karimian A (2014) Magnetic resonance image tissue classification using an automatic method. Diagnostic pathology 9: 207. pmid:25540017
View Article
PubMed/NCBI
Google Scholar

[64] View Article

[65] PubMed/NCBI

[66] Google Scholar

[ref21] 21. Deng Z, Cao L, Jiang Y, Wang S (2014) Minimax probability TSK fuzzy system classifier: a more transparent and highly interpretable classification model.
View Article
Google Scholar

[68] View Article

[69] Google Scholar

[ref22] 22. Amato F, Lopez A, Peña-Méndez EM, Vaňhara P, Hampl A, Havel J, et al. (2013) Artificial neural networks in medical diagnosis. Journal of applied biomedicine 11: 47–58.
View Article
Google Scholar

[71] View Article

[72] Google Scholar

[ref23] 23. Huang G-B, Zhu Q-Y, Siew C-K. Extreme learning machine: a new learning scheme of feedforward neural networks; 2004. IEEE. pp. 985–990.

[ref24] 24. Huang G-B, Zhu Q-Y, Siew C-K (2006) Real-time learning capability of neural networks. Neural Networks, IEEE Transactions on 17: 863–878.
View Article
Google Scholar

[75] View Article

[76] Google Scholar

[ref25] 25. Yu Q, Miche Y, Séverin E, Lendasse A (2014) Bankruptcy prediction using extreme learning machine and financial expertise. Neurocomputing 128: 296–302.
View Article
Google Scholar

[78] View Article

[79] Google Scholar

[ref26] 26. Wang X, Han M (2014) Online sequential extreme learning machine with kernels for nonstationary time series prediction. Neurocomputing 145: 90–97.
View Article
Google Scholar

[81] View Article

[82] Google Scholar

[ref27] 27. Ghouti L, Sheltami TR, Alutaibi KS (2013) Mobility prediction in mobile ad hoc networks using extreme learning machines. Procedia Computer Science 19: 305–312.
View Article
Google Scholar

[84] View Article

[85] Google Scholar

[ref28] 28. Wang DD, Wang R, Yan H (2014) Fast prediction of protein–protein interaction sites based on Extreme Learning Machines. Neurocomputing 128: 258–266.
View Article
Google Scholar

[87] View Article

[88] Google Scholar

[ref29] 29. Nian R, He B, Zheng B, Van Heeswijk M, Yu Q, Yoan M, et al. (2014) Extreme learning machine towards dynamic model hypothesis in fish ethology research. Neurocomputing 128: 273–284.
View Article
Google Scholar

[90] View Article

[91] Google Scholar

[ref30] 30. Wong PK, Wong KI, Vong CM, Cheung CS (2015) Modeling and optimization of biodiesel engine performance using kernel-based extreme learning machine and cuckoo search. Renewable Energy 74: 640–647.
View Article
Google Scholar

[93] View Article

[94] Google Scholar

[ref31] 31. Mansourvar M, Ismail MA (2014) Content-Based Image Retrieval (CBIR) in Medical Systems. International Journal of Information Technology 20.
View Article
Google Scholar

[96] View Article

[97] Google Scholar

[ref32] 32. Choras RS (2007) Image feature extraction techniques and their applications for CBIR and biometrics systems. International journal of biology and biomedical engineering 1: 6–16.
View Article
Google Scholar

[99] View Article

[100] Google Scholar

[ref33] 33. Tristan-Vega A, Arribas JI (2008) A radius and ulna TW3 bone age assessment system. Biomedical Engineering, IEEE Transactions on 55: 1463–1476.
View Article
Google Scholar

[102] View Article

[103] Google Scholar

[ref34] 34. Fischer B, Welter P, Günther RW, Deserno TM (2012) Web-based bone age assessment by content-based image retrieval for case-based reasoning. International journal of computer assisted radiology and surgery 7: 389–399. pmid:21671096
View Article
PubMed/NCBI
Google Scholar

[105] View Article

[106] PubMed/NCBI

[107] Google Scholar

[ref35] 35. Mansourvar M, Raj RG, Ismail MA, Kareem SA, Shanmugam S, Shahrom W, et al. (2012) Automated Web Based System For Bone Age Assessment Using Historam Technique. Malaysian Journal of Computer Science 25: 107.
View Article
Google Scholar

[109] View Article

[110] Google Scholar

[ref36] 36. Zhan Y, Yin J (2011) Robust local tangent space alignment via iterative weighted PCA. Neurocomputing 74: 1985–1993.
View Article
Google Scholar

[112] View Article

[113] Google Scholar

[ref37] 37. Takekawa T, Isomura Y, Fukai T (2012) Spike sorting of heterogeneous neuron types by multimodality-weighted PCA and explicit robust variational Bayes. Frontiers in neuroinformatics 6.
View Article
Google Scholar

[115] View Article

[116] Google Scholar

[ref38] 38. Fischer B, Welter P, Grouls C, Günther RW, Deserno TM. Bone age assessment by content-based image retrieval and case-based reasoning; 2011. International Society for Optics and Photonics. pp. 79630P-79630P-79610.

[ref39] 39. Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70: 489–501.
View Article
Google Scholar

[119] View Article

[120] Google Scholar

[ref40] 40. Annema A, Hoen K, Wallinga H (1994) Precision requirements for single-layer feedforward neural networks.
View Article
Google Scholar

[122] View Article

[123] Google Scholar

[ref41] 41. Zhang R, Huang G-B, Sundararajan N, Saratchandran P (2007) Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) 4: 485–495.
View Article
Google Scholar

[125] View Article

[126] Google Scholar

[ref42] 42. Huang G-B, Chen L, Siew C-K (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. Neural Networks, IEEE Transactions on 17: 879–892.
View Article
Google Scholar

[128] View Article

[129] Google Scholar

[ref43] 43. Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. Neural Networks, IEEE Transactions on 17: 1411–1423.
View Article
Google Scholar

[131] View Article

[132] Google Scholar

[ref44] 44. Huang G, Huang G-B, Song S, You K (2015) Trends in extreme learning machines: A review. Neural Networks 61: 32–48. pmid:25462632
View Article
PubMed/NCBI
Google Scholar

[134] View Article

[135] PubMed/NCBI

[136] Google Scholar

[ref45] 45. Singh R, Balasundaram S (2007) Application of extreme learning machine method for time series analysis. International Journal of Intelligent Technology 2: 256–262.
View Article
Google Scholar

[138] View Article

[139] Google Scholar

[ref46] 46. Hopfield JJ (1988) Artificial neural networks. Circuits and Devices Magazine, IEEE 4: 3–10.
View Article
Google Scholar

[141] View Article

[142] Google Scholar

[ref47] 47. Drew PJ, Monson JR (2000) Artificial neural networks. Surgery 127: 3–11. pmid:10660751
View Article
PubMed/NCBI
Google Scholar

[144] View Article

[145] PubMed/NCBI

[146] Google Scholar

[ref48] 48. Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection: MIT press.

[ref49] 49. Babovic V, Keijzer M (2005) Rainfall‐Runoff Modeling Based on Genetic Programming. Encyclopedia of Hydrological Sciences.
View Article
Google Scholar

[149] View Article

[150] Google Scholar

[ref50] 50. Khu ST, Liong SY, Babovic V, Madsen H, Muttil N (2001) Genetic Programming And Its Application In Real‐Time Runoff Forecasting1. JAWRA Journal of the American Water Resources Association 37: 439–451.
View Article
Google Scholar

[152] View Article

[153] Google Scholar

Figures

Abstract

Introduction

State of art

Methodology

Age assessment

Validation Experiments

Extreme Learning Machines (ELM)

Single hidden layer feed-forward neural network (SLFN).

Principles of ELM.

Artificial neural networks

Genetic programming

Results

Proposed model accuracy evaluation

Performance evaluation of the proposed ELM model

Architecture of soft computing models

Discussion

Performance comparison of ELM, ANN and GP

Conclusion

Acknowledgments

Author Contributions

References