+ All Categories
Home > Documents > Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple...

Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple...

Date post: 25-Jul-2021
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
10
Hindawi Publishing Corporation Mathematical Problems in Engineering Volume 2013, Article ID 395096, 9 pages http://dx.doi.org/10.1155/2013/395096 Research Article Comprehensive Models for Evaluating Rockmass Stability Based on Statistical Comparisons of Multiple Classifiers Longjun Dong and Xibing Li School of Resources and Safety Engineering, Central South University, Changsha 410083, China Correspondence should be addressed to Longjun Dong; [email protected] Received 14 July 2013; Accepted 7 August 2013 Academic Editor: Baochang Zhang Copyright © 2013 L. Dong and X. Li. is is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. e relationships between geological features and rockmass behaviors under complex geological environments were investigated based on multiple intelligence classifiers. Random forest, support vector machine, bayes’ classifier, fisher’s classifier, logistic regression, and neural networks were used to establish models for evaluating the rockmass stability of slope. Samples of both circular failure mechanism and wedge failure mechanism were considered to establish and calibrate the comprehensive models. e classification performances of different modeling approaches were analyzed and compared by receiver operating characteristic (ROC) curves systematically. Results show that the proposed random forest model has the highest accuracy for evaluating slope stability of circular failure mechanism, while the support vector Machine model has the highest accuracy for evaluating slope stability of wedge failure mechanism. It is demonstrated that the established random forest and the support vector machine models are effective and efficient approaches to evaluate the rockmass stability of slope. 1. Introduction Since their introduction, researches into the areas of machine learning and their applications continue to captivate scientists and engineers from a variety of disciplines. is growing interest among researchers is stemming from the fact that these learning machines have an excellent performance in the issues of pattern recognition and the modeling of nonlinear relationships of multivariate dynamic systems [1]. e widely used and representative classification methods include ran- dom forest, support vector machine, baye’s classifier, fisher’s classifier, logistic regression, and neural networks. Comprehensive classification of slope rockmasses, an important activity during exploration, design, and construc- tion for underground openings, is restrained by our limita- tions in defining the complex geological environments and modeling the relationships between geological features and rockmass behaviors [2, 3]. e published literatures report- ing on learning machines provided effective and efficient approaches to establish the nonlinear relationships between geological features and rockmass behaviors [4, 5]. Some recent publications on various geotechnical engi- neering topics using different methods are given as follows: remote sensing and GIS based landslide susceptibility as- sessment [6]; landslide susceptibility mapping [79]; early warning landslide susceptibility model using geographic in- formation system (GIS) [10]; regional prediction of landslide hazard [11]; predicting of rockburst classification [12, 13]; predicting destructive effect of masonry structure under blasting vibration of open-pit mine [14]; prediction of seismic liquefaction of sand soil [15]; classification of rocks surround- ing in tunnel [16, 17]; classification of top coal cavability of the steep seam [18]; comprehensive evaluation for seismic stability of slopes [19]; prediction rock mechanical behaviors [4]; predicting landslide deformation [20, 21]; predicting of P-wave velocity and anisotropic property of rock [22]; estimating rock properties using sound levels produced dur- ing drilling [23]; automated tunnel rock classification using rock engineering systems [24]; estimation of the rock mass deformation modulus using a rock classification system [25]; predicting blast disaster in open pit blasting operation [26, 27]; evaluation of penetration rate of tunnel boring machine in hard rock condition [28]; comparative study of cognitive systems for ground vibration measurements [29]; prediction of longitudinal wave velocity [30]; optimization of tunnel construction [31]; prediction of the rock mass diggability
Transcript
Page 1: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

Hindawi Publishing CorporationMathematical Problems in EngineeringVolume 2013 Article ID 395096 9 pageshttpdxdoiorg1011552013395096

Research ArticleComprehensive Models for Evaluating Rockmass StabilityBased on Statistical Comparisons of Multiple Classifiers

Longjun Dong and Xibing Li

School of Resources and Safety Engineering Central South University Changsha 410083 China

Correspondence should be addressed to Longjun Dong rydong001csueducn

Received 14 July 2013 Accepted 7 August 2013

Academic Editor Baochang Zhang

Copyright copy 2013 L Dong and X Li This is an open access article distributed under the Creative Commons Attribution Licensewhich permits unrestricted use distribution and reproduction in any medium provided the original work is properly cited

The relationships between geological features and rockmass behaviors under complex geological environments were investigatedbased on multiple intelligence classifiers Random forest support vector machine bayesrsquo classifier fisherrsquos classifier logisticregression and neural networks were used to establish models for evaluating the rockmass stability of slope Samples of bothcircular failure mechanism and wedge failure mechanism were considered to establish and calibrate the comprehensive modelsThe classification performances of different modeling approaches were analyzed and compared by receiver operating characteristic(ROC) curves systematically Results show that the proposed random forest model has the highest accuracy for evaluating slopestability of circular failure mechanism while the support vector Machine model has the highest accuracy for evaluating slopestability of wedge failure mechanism It is demonstrated that the established random forest and the support vector machine modelsare effective and efficient approaches to evaluate the rockmass stability of slope

1 Introduction

Since their introduction researches into the areas of machinelearning and their applications continue to captivate scientistsand engineers from a variety of disciplines This growinginterest among researchers is stemming from the fact thatthese learningmachines have an excellent performance in theissues of pattern recognition and the modeling of nonlinearrelationships of multivariate dynamic systems [1] The widelyused and representative classification methods include ran-dom forest support vector machine bayersquos classifier fisherrsquosclassifier logistic regression and neural networks

Comprehensive classification of slope rockmasses animportant activity during exploration design and construc-tion for underground openings is restrained by our limita-tions in defining the complex geological environments andmodeling the relationships between geological features androckmass behaviors [2 3] The published literatures report-ing on learning machines provided effective and efficientapproaches to establish the nonlinear relationships betweengeological features and rockmass behaviors [4 5]

Some recent publications on various geotechnical engi-neering topics using different methods are given as follows

remote sensing and GIS based landslide susceptibility as-sessment [6] landslide susceptibility mapping [7ndash9] earlywarning landslide susceptibility model using geographic in-formation system (GIS) [10] regional prediction of landslidehazard [11] predicting of rockburst classification [12 13]predicting destructive effect of masonry structure underblasting vibration of open-pit mine [14] prediction of seismicliquefaction of sand soil [15] classification of rocks surround-ing in tunnel [16 17] classification of top coal cavability ofthe steep seam [18] comprehensive evaluation for seismicstability of slopes [19] prediction rock mechanical behaviors[4] predicting landslide deformation [20 21] predictingof P-wave velocity and anisotropic property of rock [22]estimating rock properties using sound levels produced dur-ing drilling [23] automated tunnel rock classification usingrock engineering systems [24] estimation of the rock massdeformation modulus using a rock classification system [25]predicting blast disaster in open pit blasting operation [2627] evaluation of penetration rate of tunnel boring machinein hard rock condition [28] comparative study of cognitivesystems for ground vibration measurements [29] predictionof longitudinal wave velocity [30] optimization of tunnelconstruction [31] prediction of the rock mass diggability

2 Mathematical Problems in Engineering

index [32] prediction of rock properties from sound levelsproduced during drilling [5] modeling mine gas gushingforecasting on virtual environment [33] rainfall reliabilityevaluation for stability of municipal solid waste landfills onslope [34] determination of reservoir induced earthquake[35] seismic event identification [36] and prediction ofelastic modulus of jointed rock mass [37]

However researchers study the applications of supportvector machine bayesrsquo classifier fisherrsquos classifier logisticregression and neural networks for evaluating rockmass sta-bility but few focus on applications of the advanced randomforest method in the area especially that few focus on theoverall comparison of performances of different classifiers

This paper investigated the validity of utilizing differentlearning machines in the physical problem of slope stabilityprediction Random forest support vector machine bayesrsquoclassifier fisherrsquos classifier logistic regression and neuralnetworks were used to establish comprehensive models forevaluating rockmass stability of slope and the classificationperformances of different modeling approaches are analyzedand compared using ROC curves

2 Data Models and Results

21 Data The main scope of this work is to implement therandom forest support vector machine bayesrsquo classifier fish-errsquos classifier logistic regression and neural networks in theproblem of slope stability estimation In order to forecast thestatus of stability (119878) in the case of rock or soil slopes thefactors that influence 119878 have to be determinedThe input layerdata consist of six input parameters in the case of circularfailure and eight input parameters in the case of wedge failureThe output layer is composed of a single output parameterthe status of stability (119878) In this work the status of stabilityis considered as a function approximation problem takingvalues in the range of [0 1] instead of the discrete values 0and 1 with 1 indicating stable and 0 indicating failed

The datasets used in this paper were collected fromthe publication by Sakellariou and Ferentinou [1] The firstdataset consists of 46 case studies of slopes analyzed forcircular critical failure mechanism Of them 23 cases are dry(13 failed and 10 stable) and 23 cases are wet (16 failed and7 stable) The second dataset consists of 22 case studies ofrock slopes analyzed for wedge failure mechanism All casesare dry (10 failed and 12 stable) The original data coveringthe 46 case studies are presented in Table 1 while the originaldata covering the 22 case studies are presented in Table 2 Inthe tables 119865 is the safety factor The parameters that havebeen selected are related to the geotechnical properties andthe geometry of each slope More specifically the parametersused for circular failure (Figure 1(a)) were unit weight (120574)cohesion (119888) angle of internal friction (120601) slope angle (120573)height (119867) and pore water pressure (119903

119906) In the case of wedge

failure (Figure 1(b)) the corresponding input parameterswere unit weight (120574) cohesions (119888

119860) and (119888

119861) angles of

internal friction (120601119860) and (120601

119861) angle of the line of intersection

of the two joint sets (120595119901) slope angle (120595

119904) and height (119867)

where 119860 and 119861 refer to the two joint sets

22 Random Forest Models The random forest [38] is anensemble approach that can also be thought of as a formof the nearest neighbor predictor Random forests are anensemble learning method for classification (and regression)that operates by constructing a multitude of decision trees attraining time and outputting the class that is the model of theclasses output by individual treesThe algorithm for inducinga random forest was developed by Breiman [38] and AdeleCutler and ldquoRandom Forestsrdquo is their trademark

The principle of random forests (RFs) is the aggregationof a large ensemble of decision trees [38] During trainingeach individual tree in the ensemble is fitted by sampling thetraining data with replacement (bootstrap) and growing thetree to full depth on the training sample The optimal datasplit at each tree node is determined by randomly choosing119898of the available 119875 input variables and selecting the one whichsplits the node best

This implementation is based on the original Fortran codeauthored by Breiman the inventor of RFs We considereddifferent parameter configurations for the values of 119899tree =300 500 and 1000 (number of trees to build) and nodesize =2 (minimal size of the terminal nodes of the tree) The resultsfor circular failure mechanism and wedge failure mechanismare listed in Tables 1 and 2

23 Support Vector Machine Models The extensive applica-tions literature on text categorization image recognitionrockmechanics and other fields shows the excellent empiricalperformance of support vectormachine (SVM) inmanymoredomains [4 39] The underlying idea of SVM classifiers isto calculate a maximal margin hyperplane separating twoclasses of the data

To learn nonlinearly separable functions the data areimplicitly mapped to a higher-dimensional space by meansof a kernel function where a separating hyperplane is foundNew samples are classified according to the side of thehyperplane they belong to [22] Many extensions of the basicSVM algorithm can handle multicategory data The ldquoone-versus-restrdquo SVMworks better for multiclass microarray data[1 6] so this method was adopted for the analysis of multi-category datasets in the present study In summary thisapproach involves building a separate SVMmodel to classifyeach class against the rest and then predict the class of a newsample using the SVMmodel with the strongest vote

We used SVM implementation in the DPS software withRBF kernel The type of support vector machine is C-SVCthe kernal function is RBF and 119862 value is 1 The results forcircular failure mechanism and wedge failure mechanism arelisted in Tables 1 and 2 respectively

24 Bayesrsquo Classification Models The aim of the naive baye-sian classifier (NBC) as with other classifiers is to assign anobject 119868 to one of discrete sets of categories 119862

1 1198622 119862

119898

based on its observable attributes 1198831 1198832 119883

119899 NBCs are

used in a variety of applications including document clas-sificationmedical diagnosis [40] systems performanceman-agement probability classification of rockburst [41] andother fields Domingos and Pazzani [42] proved optimality of

Mathematical Problems in Engineering 3

Table 1 Samples for circular failure mechanism and results

Case no 120574 (KNm3) 119862 (kPa) Φ (∘) 120573 (∘) 119867 (m) 119903119906

119878 119865 Moisture Bayes Fisher SVM LR BP RF1 1868 2634 15 35 823 0 Failed 111 Dry 0 0 0 0 0 02 214 10 3034 30 20 0 Stable 17 Dry 1 1 1 1 1 13 23 0 20 20 100 03 Failed 12 Wet 0 0 0 0 0 04 16 70 20 40 115 0 Failed 111 Dry 0 0 0 0 0 05 1884 1436 25 20 305 045 Failed 111 Wet 0 1 0 0 0 06 20 0 36 45 50 05 Failed 067 Wet 0 0 0 0 0 07 185 12 0 30 6 0 Failed 078 Dry 0 0 0 0 0 08 22 20 36 45 50 0 Failed 102 Dry 0 0 0 0 0 09 12 0 30 35 4 0 Stable 146 Dry 0 0 1 0 1 110 2143 0 20 20 61 05 Failed 103 Wet 0 0 0 0 0 011 22 0 40 33 8 035 Stable 145 Wet 1 1 1 1 1 112 206 1628 265 30 40 0 Failed 125 Dry 1 1 0 1 0 013 18 5 30 20 8 03 Stable 205 Wet 1 1 1 1 1 114 2347 0 32 37 214 0 Failed 108 Dry 0 0 0 0 0 015 20 20 36 45 50 05 Failed 083 Wet 0 0 0 0 0 016 2041 249 13 22 1067 035 Stable 14 Wet 0 0 1 0 0 117 18 24 3015 45 20 012 Failed 112 Wet 0 0 0 0 0 018 2844 3923 38 35 100 0 Stable 199 Dry 1 1 1 1 1 119 2151 694 30 31 7681 038 Failed 101 Wet 0 0 0 0 0 020 224 10 35 45 10 04 Failed 09 Wet 0 0 0 0 0 021 14 1197 26 30 88 0 Failed 102 Dry 0 0 0 0 0 022 22 0 36 45 50 0 Failed 089 Dry 0 0 0 0 0 023 20 0 245 20 8 035 Stable 137 Wet 1 1 1 1 1 124 2844 2942 35 35 100 0 Stable 178 Dry 1 1 1 0 1 125 25 120 45 53 120 0 Stable 13 Dry 1 1 1 1 1 126 1963 1197 20 22 1219 0405 Failed 135 Wet 0 0 0 0 0 027 2041 3352 11 16 4572 02 Failed 128 Wet 0 0 0 0 0 028 224 100 45 45 15 025 Stable 18 Wet 1 1 1 1 1 129 1884 1436 25 20 305 0 Stable 1875 Dry 1 1 1 1 1 130 12 0 30 45 8 0 Failed 086 Dry 0 0 0 0 0 031 1884 1532 30 25 1067 038 Stable 163 Wet 1 1 0 1 1 032 2182 862 32 28 128 049 Failed 103 Wet 1 1 0 1 1 033 165 1149 0 30 366 0 Failed 1 Dry 0 0 0 0 0 034 906 1171 28 35 21 011 Failed 109 Wet 0 0 0 0 0 035 12 0 30 45 8 0 Failed 08 Dry 0 0 0 0 0 036 185 25 0 30 6 0 Failed 109 Dry 0 0 0 0 0 037 20 20 36 45 50 025 Failed 096 Wet 0 0 0 0 0 038 1884 5746 20 20 305 0 Stable 2045 Dry 1 1 0 1 0 039 24 0 40 33 8 03 Stable 158 Wet 1 1 0 1 1 140 26 15005 45 50 200 0 Stable 12 Dry 1 1 1 0 0 141 148 0 17 20 50 0 Failed 113 Dry 0 0 0 0 0 042 12 0 30 35 4 0 Stable 144 Dry 0 0 0 0 1 143 224 10 35 30 10 0 Stable 2 Dry 1 1 1 1 1 144 1884 0 20 20 762 045 Failed 105 Wet 0 0 0 0 0 045 20 0 36 45 50 025 Failed 079 Wet 0 0 0 0 0 046 14 1197 26 30 88 045 Failed 0625 Wet 0 0 0 0 0 0

4 Mathematical Problems in Engineering

Table 2 Samples for wedge failure mechanism and results

No 120574 (KNm3) 119888119860(KPa) 119888

119861(KPa) 120601

119860(∘) 120601

119861(∘) Ψ

119901(∘) Ψ

119904(∘) 119867 (m) 119878 119865 Moisture Bayes Fisher LR NN RF SVM

1 27 0 0 30 30 375 26 110 Stable 209 Dry 1 1 1 1 1 12 26 0 0 306 228 306 33 270 Stable 14 Dry 1 1 1 1 1 13 2324 1915 2873 226 191 29 40 46 Failed 1 Dry 0 0 0 0 0 04 2514 2394 4788 20 30 312 65 305 Stable 136 Dry 1 1 1 1 1 15 27 0 0 15 15 43 26 60 Failed 097 Dry 0 0 0 0 0 06 26 20 20 27 27 60 70 44 Stable 235 Dry 1 1 1 0 1 17 27 0 0 20 30 375 26 50 Stable 165 Dry 1 1 1 0 1 18 27 0 0 10 10 43 26 60 Failed 064 Dry 0 0 0 0 0 09 2666 0 0 45 45 35 50 150 Stable 248 Dry 1 1 1 1 1 110 20 0 0 40 40 45 60 100 Failed 086 Dry 0 0 0 0 0 011 27 20 20 20 30 43 26 60 Stable 218 Dry 1 1 1 1 1 112 199 40 19 22 22 37 42 140 Failed 09 Dry 0 0 0 1 0 013 27 0 0 20 30 375 26 110 Stable 165 Dry 1 1 1 1 1 114 1884 0 0 30 30 375 45 61 Failed 078 Dry 0 0 0 0 0 015 1884 3007 36 30 367 375 45 61 Failed 112 Dry 0 0 0 0 0 016 2666 0 0 35 35 30 42 150 Stable 173 Dry 1 1 1 1 1 117 26 0 0 39 39 60 70 44 Failed 09 Dry 1 1 1 0 1 118 25 1436 1676 28 18 30 45 37 Failed 1 Dry 0 0 0 0 1 019 228 0 0 35 35 38 47 110 Failed 11 Dry 0 0 0 0 0 020 24 245 49 20 30 65 31 40 Stable 177 Dry 1 1 1 1 1 121 25 0 0 324 324 30 48 50 Stable 19 Dry 0 0 0 0 1 122 27 0 0 20 30 43 26 50 Stable 165 Dry 1 1 1 0 1 1

120573H

ru 120574 120601 c

(a)

120601A cA120595p

120601B cB

H120595s

120574

(b)

Figure 1 Failure models (a) circular failure mechanism and (b) wedge failure mechanism

the NBC under certain conditions even when the conditionalindependence assumption is violated

This probability calculation is straightforward condi-tioning on the observed attributes we want to find theprobability that 119868 belongs to each category that is 119875(119868 isin 119862

119894|

1198831 1198832 119883

119899)

Applying Bayesrsquo Theorem [39] this is rewritten as

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)

=119875 (119868 isin 119862

119894) 119875 (119883

1 1198832 119883

119899| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(1)

Under the mutual conditional independence assumption[39] this reduces to

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)=

119875 (119868 isin 119862119894)prod119899

119895=1119875 (119883119895| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(2)

for each category 119862119894 Since the denominator will be the same

for all categories we only need to calculate the numerator foreach category 119894 choosing

119894lowast

isin arg max119875 (119868 isin 119862119894)

119899

prod

119895=1

119875 (119883119895| 119868 isin 119862

119894) (3)

and assigning 119868 to category 119862119894lowast Then the probability that an

event 119868 belongs to category 119862119894is computed by (2)

In the present study unit weight (120574) cohesion (119888) angleof internal friction (120601) slope angle (120573) height (119867) andpore water pressure (119903

119906) for circular failure mechanism were

expressed as11988311198832119883311988341198835 and119883

6The implementation

was through the SPSS software with actual sizes of samplesas a priori probabilities and the discriminant function wasgiven as follows

119884Failed = 169401198831minus 00891119883

2minus 03232119883

3+ 06099119883

4

minus 001861198835+ 81056119883

6minus 229527

Mathematical Problems in Engineering 5

119884Stable = 190051198831minus 00341119883

2+ 00287119883

3+ 02657119883

4

minus 006031198835minus 11166119883

6minus 243608

(4)

For the case of wedge failure mechanism unit weight (120574)cohesions (119888

119860) and (119888

119861) angles of internal friction (120601

119860) and

(120601119861) angle of the line of intersection of the two joint sets (120595

119901)

slope angle (120595119904) and height (119867) are expressed as 119883

1199081 1198831199082

11988311990831198831199084119883119908511988311990861198831199087 and119883

1199088 Bayesrsquo functions are given

as follows

119884Failed = 15141198831199081

minus 0531198831199082

minus 0821198831199083

minus 1601198831199084

+ 4571198831199085

+ 1161198831199086

+ 0311198831199087

+ 0361198831199088

minus 25377

119884Stable = 17981198831199081

minus 0421198831199082

minus 1221198831199083

minus 2281198831199084

+ 5901198831199085

+ 1451198831199086

+ 0301198831199087

+ 0471198831199088

minus 36560

(5)

According to the above established models the results ofcircular failure mechanism and wedge failure mechanismcases were obtained and listed in Tables 1 and 2 respectively

25 Fisherrsquos Classification Models Fisherrsquos discriminant anal-ysis is a classification method that projects high-dimensionaldata onto a line and performs classification in this one-dimensional space which is widely used to determine whichvariable discriminates between two or more classes and toderive a classification model for predicting the group mem-bership of new observations with high accuracy [14ndash16 4344] In the present work the Fisher discriminant analysis wasused to establish discriminator for discriminating betweenfailed and stable statuses of slope

Based on the Fisher discriminant theory the score ofFisher discriminator can be calculated by

119884Fisher = 1198620+

119899

sum

119894=1

119862119894119883119894 (6)

where119862119894is the coefficient of the Fisher discriminator And the

Fisher scores of the center for failed and stable statusescan becalculated as 119884

119891and 119884

119904 respectivelyThen the threshold can

be obtained by 05(119884119891+ 119884119904) Every case has a set of values of

119883119894 and corresponding to a Fisher score if the Fisher score

is greater than the threshold the slope belongs to stable theslope otherwise to the failed slope

The indicators unit weight (120574) cohesion (119888) angle ofinternal friction (120601) slope angle (120573) height (119867) and pore

water pressure (119903119906) for circular failure mechanism are also

expressed as 1198831 1198832 1198833 1198834 1198835 and 119883

6 The calculation

was executed through the SPSS software The discriminantfunction is

119884Fisher = minus 0091198831minus 002119883

2minus 015119883

3+ 014119883

4

+ 0021198835+ 387119883

6+ 004

(7)

The 119884119891and 119884

119904are 0874 and minus1509 respectively

For the case of wedge failure mechanism as inSection 24 unit weight (120574) cohesions (119888

119860) and (119888

119861)

angles of internal friction (120601119860) and (120601

119861) angle of the line of

intersection of the two joint sets (120595119901) slope angle (120595

119904) and

height (119867) are also expressed as 1198831199081 1198831199082 1198831199083 1198831199084 1198831199085

1198831199086 1198831199087 and 119883

1199088 The Fisher discriminant function is

given as follows and the 119884119891and 119884

119904are minus2743 and 2134

respectively as

119884Fisher = 0581198831199081

minus 0021198831199082

+ 0081198831199083

minus 0141198831199084

+ 0271198831199085

+ 0061198831199086

+ 00031198831199087

+ 0021198831199088

minus 2323

(8)

According to the above established Fisher models the resultsof circular failure mechanism and wedge failure mechanismcases were also obtained and listed in Tables 1 and 2respectively

26 Logistic Regression Models Logistic regression (LR) is astatistical modeling technique in which the probability of acategory is related to a set of explanatory variables An expla-nation of logistic regression begins with an explanation of thelogistic function which always takes values between zero andoneThe logistic model is defined by the following equations

119911 = 1198860+

119899

sum

119894=1

119886119894119909119894

119875 (119911) =119890119911

1 + 119890119911

(9)

where 119911 is a measure of the contribution of the explanatoryvariables 119909

119894(119894 = 1 119899) 119886

119894are the regression coefficients

which are obtained by maximum likelihood in conjunctionwith their standard errors Δ119886

119894 and 119875(119911) is the categorical

response of variables that represents the probability of aparticular outcome In this particular application 119909

119894are

the slope rockmass parameters of interest and 119875(119911) isthe probability of having stable and failed statuses Thecalculation of LR is finished through the SPSS software andlogistic functions for circular failure mechanism and wedgefailure mechanism cases are given as follows

119875 (119911119888) =

1198900459119909

1minus0145119909

2+0515119909

3minus047119909

4minus0147119909

5minus13936119909

6minus4262

1 + 11989004591199091minus01451199092+05151199093minus0471199094minus01471199095minus139361199096minus4262

119875 (119911119908) =

1198908201119909

1199081+0567119909

1199082+0344119909

1199083minus1264119909

1199084+3185119909

1199085+0558119909

1199086minus005119909

1199087+0225119909

1199088minus30438

1 + 11989082011199091199081+05671199091199082+03441199091199083minus12641199091199084+31851199091199085+05581199091199086minus0051199091199087+02251199091199088minus30438

(10)

6 Mathematical Problems in Engineering

The threshold of the above two logistic regression models is05 and the results are listed in Tables 1 and 2

27 Neural Networks Models Neural networks (NNs) havelong been used in problems such as this with a lot of datamany variables and the possibility of noise in the data

Each input point is a high-dimensional vectorThe neuralnetwork is organized in a series of layers where the inputvector enters at the left side of the network which is thenprojected to a ldquohidden layerrdquo Each unit in the hidden layer isa weighed sum of the values in the first layer This layer thenprojects to an output layer which is where the desired answerappears

In the present work a multi-layer perceptron networkmodel is used Training took place for the specific rangeof values that cover the training dataset Trying to achievethe best networkrsquos performance several networks with dif-ferent architectures were developed using all of the possiblevariations of the backpropagation algorithms available inMATLAB 2010b The final network architecture for theprediction of safety factor against circular failure it is (6-10-1)whereas in the case of wedge failure is (8-12-1) The learningrate was set to 001 and the error goal was set to 00001The results for circular failure mechanism and wedge failuremechanism are listed in Tables 1 and 2 respectively

3 Comparisons and Discussions

The ROC curve is used to evaluate and compare the estab-lished RF SVM Bayes Fisher LR and NN classificationmodels in slope stability evaluation ROC is a graphical plotwhich illustrates the performance of a binary classifier systemas its discrimination threshold is varied [45] It is createdby plotting the fraction of true positives out of the positives(TPR = true positive rate) versus the fraction of false positivesout of the negatives (FPR = false positive rate) at variousthreshold settings

ROC analysis provides tools to select possibly optimalmodels and to discard suboptimal ones independently from(and prior to specifying) the cost context or the class distri-bution ROC analysis is related in a direct and natural way tocostbenefit analysis of diagnostic decision making

In the present study the stable and failed statuses ofslopewere considered a two-class prediction problem (binaryclassification) in which the outcomes were labeled eitheras positive (119901 stable) or negative (119899 failed) There are fourpossible outcomes from a binary classifier If the outcomefrom a prediction is 1199011015840 and the actual value is also 119901 then it iscalled true positive (TP) however if the actual value is 119899 thenit is said to be false positive (FP) Conversely a true negative(TN) value has occurred when both the prediction outcomeand the actual value are 119899 and a false negative (FN) value iswhen the prediction outcome is 1198991015840 while the actual value is 119901

An experiment from 119901 positive and 119899 negative wasdefined for instances The four outcomes can be formulatedin a 2 times 2 contingency table or a confusion matrix as followsin Table 3

Table 3 Contingency matrix for the two-class prediction problem

Actual value Total119901 119899

Predictionoutcome

1199011015840 True positive (TP) False positive (FP) 119901

1198991015840 False negative (FN) True negative (TN) 119899

Total 119901 119899

0102030405060708090

100

Bayes Fisher SVM LR NN RF TFN 3 3 4 5 3 2 0FP 2 3 0 2 1 0 0TN 27 26 29 27 28 29 29TP 14 14 13 12 14 15 17

Prop

ortio

n (

)(a)

0102030405060708090

100

Bayes Fisher SVMLR NN RF TFNFPTNTP

Prop

ortio

n (

)

1 1 1 4 0 0 01 1 1 1 2 1 09 9 9 9 8 9 10

11 11 11 8 12 12 12

(b)

Figure 2 Proportions of TP TN FP and FN for the RF SVMBayes Fisher LR and NN classification models (a) circular failuremechanism and (b) wedge failure mechanism

The specificity or the true negative rate (TNR) is definedas the percentage of slope which is correctly identified asbeing failed

Specificity = TNTN + FP

(11)

The quantity 1 minus specificity is the false positive rate and isthe percentage of slopes that are incorrectly identified asbeing stable statuses The sensitivity or the true positive rate(TPR) is defined as the percentage of slope which is correctlyidentified as being stable status

Sensitivity = TPTP + FN

(12)

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 2: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

2 Mathematical Problems in Engineering

index [32] prediction of rock properties from sound levelsproduced during drilling [5] modeling mine gas gushingforecasting on virtual environment [33] rainfall reliabilityevaluation for stability of municipal solid waste landfills onslope [34] determination of reservoir induced earthquake[35] seismic event identification [36] and prediction ofelastic modulus of jointed rock mass [37]

However researchers study the applications of supportvector machine bayesrsquo classifier fisherrsquos classifier logisticregression and neural networks for evaluating rockmass sta-bility but few focus on applications of the advanced randomforest method in the area especially that few focus on theoverall comparison of performances of different classifiers

This paper investigated the validity of utilizing differentlearning machines in the physical problem of slope stabilityprediction Random forest support vector machine bayesrsquoclassifier fisherrsquos classifier logistic regression and neuralnetworks were used to establish comprehensive models forevaluating rockmass stability of slope and the classificationperformances of different modeling approaches are analyzedand compared using ROC curves

2 Data Models and Results

21 Data The main scope of this work is to implement therandom forest support vector machine bayesrsquo classifier fish-errsquos classifier logistic regression and neural networks in theproblem of slope stability estimation In order to forecast thestatus of stability (119878) in the case of rock or soil slopes thefactors that influence 119878 have to be determinedThe input layerdata consist of six input parameters in the case of circularfailure and eight input parameters in the case of wedge failureThe output layer is composed of a single output parameterthe status of stability (119878) In this work the status of stabilityis considered as a function approximation problem takingvalues in the range of [0 1] instead of the discrete values 0and 1 with 1 indicating stable and 0 indicating failed

The datasets used in this paper were collected fromthe publication by Sakellariou and Ferentinou [1] The firstdataset consists of 46 case studies of slopes analyzed forcircular critical failure mechanism Of them 23 cases are dry(13 failed and 10 stable) and 23 cases are wet (16 failed and7 stable) The second dataset consists of 22 case studies ofrock slopes analyzed for wedge failure mechanism All casesare dry (10 failed and 12 stable) The original data coveringthe 46 case studies are presented in Table 1 while the originaldata covering the 22 case studies are presented in Table 2 Inthe tables 119865 is the safety factor The parameters that havebeen selected are related to the geotechnical properties andthe geometry of each slope More specifically the parametersused for circular failure (Figure 1(a)) were unit weight (120574)cohesion (119888) angle of internal friction (120601) slope angle (120573)height (119867) and pore water pressure (119903

119906) In the case of wedge

failure (Figure 1(b)) the corresponding input parameterswere unit weight (120574) cohesions (119888

119860) and (119888

119861) angles of

internal friction (120601119860) and (120601

119861) angle of the line of intersection

of the two joint sets (120595119901) slope angle (120595

119904) and height (119867)

where 119860 and 119861 refer to the two joint sets

22 Random Forest Models The random forest [38] is anensemble approach that can also be thought of as a formof the nearest neighbor predictor Random forests are anensemble learning method for classification (and regression)that operates by constructing a multitude of decision trees attraining time and outputting the class that is the model of theclasses output by individual treesThe algorithm for inducinga random forest was developed by Breiman [38] and AdeleCutler and ldquoRandom Forestsrdquo is their trademark

The principle of random forests (RFs) is the aggregationof a large ensemble of decision trees [38] During trainingeach individual tree in the ensemble is fitted by sampling thetraining data with replacement (bootstrap) and growing thetree to full depth on the training sample The optimal datasplit at each tree node is determined by randomly choosing119898of the available 119875 input variables and selecting the one whichsplits the node best

This implementation is based on the original Fortran codeauthored by Breiman the inventor of RFs We considereddifferent parameter configurations for the values of 119899tree =300 500 and 1000 (number of trees to build) and nodesize =2 (minimal size of the terminal nodes of the tree) The resultsfor circular failure mechanism and wedge failure mechanismare listed in Tables 1 and 2

23 Support Vector Machine Models The extensive applica-tions literature on text categorization image recognitionrockmechanics and other fields shows the excellent empiricalperformance of support vectormachine (SVM) inmanymoredomains [4 39] The underlying idea of SVM classifiers isto calculate a maximal margin hyperplane separating twoclasses of the data

To learn nonlinearly separable functions the data areimplicitly mapped to a higher-dimensional space by meansof a kernel function where a separating hyperplane is foundNew samples are classified according to the side of thehyperplane they belong to [22] Many extensions of the basicSVM algorithm can handle multicategory data The ldquoone-versus-restrdquo SVMworks better for multiclass microarray data[1 6] so this method was adopted for the analysis of multi-category datasets in the present study In summary thisapproach involves building a separate SVMmodel to classifyeach class against the rest and then predict the class of a newsample using the SVMmodel with the strongest vote

We used SVM implementation in the DPS software withRBF kernel The type of support vector machine is C-SVCthe kernal function is RBF and 119862 value is 1 The results forcircular failure mechanism and wedge failure mechanism arelisted in Tables 1 and 2 respectively

24 Bayesrsquo Classification Models The aim of the naive baye-sian classifier (NBC) as with other classifiers is to assign anobject 119868 to one of discrete sets of categories 119862

1 1198622 119862

119898

based on its observable attributes 1198831 1198832 119883

119899 NBCs are

used in a variety of applications including document clas-sificationmedical diagnosis [40] systems performanceman-agement probability classification of rockburst [41] andother fields Domingos and Pazzani [42] proved optimality of

Mathematical Problems in Engineering 3

Table 1 Samples for circular failure mechanism and results

Case no 120574 (KNm3) 119862 (kPa) Φ (∘) 120573 (∘) 119867 (m) 119903119906

119878 119865 Moisture Bayes Fisher SVM LR BP RF1 1868 2634 15 35 823 0 Failed 111 Dry 0 0 0 0 0 02 214 10 3034 30 20 0 Stable 17 Dry 1 1 1 1 1 13 23 0 20 20 100 03 Failed 12 Wet 0 0 0 0 0 04 16 70 20 40 115 0 Failed 111 Dry 0 0 0 0 0 05 1884 1436 25 20 305 045 Failed 111 Wet 0 1 0 0 0 06 20 0 36 45 50 05 Failed 067 Wet 0 0 0 0 0 07 185 12 0 30 6 0 Failed 078 Dry 0 0 0 0 0 08 22 20 36 45 50 0 Failed 102 Dry 0 0 0 0 0 09 12 0 30 35 4 0 Stable 146 Dry 0 0 1 0 1 110 2143 0 20 20 61 05 Failed 103 Wet 0 0 0 0 0 011 22 0 40 33 8 035 Stable 145 Wet 1 1 1 1 1 112 206 1628 265 30 40 0 Failed 125 Dry 1 1 0 1 0 013 18 5 30 20 8 03 Stable 205 Wet 1 1 1 1 1 114 2347 0 32 37 214 0 Failed 108 Dry 0 0 0 0 0 015 20 20 36 45 50 05 Failed 083 Wet 0 0 0 0 0 016 2041 249 13 22 1067 035 Stable 14 Wet 0 0 1 0 0 117 18 24 3015 45 20 012 Failed 112 Wet 0 0 0 0 0 018 2844 3923 38 35 100 0 Stable 199 Dry 1 1 1 1 1 119 2151 694 30 31 7681 038 Failed 101 Wet 0 0 0 0 0 020 224 10 35 45 10 04 Failed 09 Wet 0 0 0 0 0 021 14 1197 26 30 88 0 Failed 102 Dry 0 0 0 0 0 022 22 0 36 45 50 0 Failed 089 Dry 0 0 0 0 0 023 20 0 245 20 8 035 Stable 137 Wet 1 1 1 1 1 124 2844 2942 35 35 100 0 Stable 178 Dry 1 1 1 0 1 125 25 120 45 53 120 0 Stable 13 Dry 1 1 1 1 1 126 1963 1197 20 22 1219 0405 Failed 135 Wet 0 0 0 0 0 027 2041 3352 11 16 4572 02 Failed 128 Wet 0 0 0 0 0 028 224 100 45 45 15 025 Stable 18 Wet 1 1 1 1 1 129 1884 1436 25 20 305 0 Stable 1875 Dry 1 1 1 1 1 130 12 0 30 45 8 0 Failed 086 Dry 0 0 0 0 0 031 1884 1532 30 25 1067 038 Stable 163 Wet 1 1 0 1 1 032 2182 862 32 28 128 049 Failed 103 Wet 1 1 0 1 1 033 165 1149 0 30 366 0 Failed 1 Dry 0 0 0 0 0 034 906 1171 28 35 21 011 Failed 109 Wet 0 0 0 0 0 035 12 0 30 45 8 0 Failed 08 Dry 0 0 0 0 0 036 185 25 0 30 6 0 Failed 109 Dry 0 0 0 0 0 037 20 20 36 45 50 025 Failed 096 Wet 0 0 0 0 0 038 1884 5746 20 20 305 0 Stable 2045 Dry 1 1 0 1 0 039 24 0 40 33 8 03 Stable 158 Wet 1 1 0 1 1 140 26 15005 45 50 200 0 Stable 12 Dry 1 1 1 0 0 141 148 0 17 20 50 0 Failed 113 Dry 0 0 0 0 0 042 12 0 30 35 4 0 Stable 144 Dry 0 0 0 0 1 143 224 10 35 30 10 0 Stable 2 Dry 1 1 1 1 1 144 1884 0 20 20 762 045 Failed 105 Wet 0 0 0 0 0 045 20 0 36 45 50 025 Failed 079 Wet 0 0 0 0 0 046 14 1197 26 30 88 045 Failed 0625 Wet 0 0 0 0 0 0

4 Mathematical Problems in Engineering

Table 2 Samples for wedge failure mechanism and results

No 120574 (KNm3) 119888119860(KPa) 119888

119861(KPa) 120601

119860(∘) 120601

119861(∘) Ψ

119901(∘) Ψ

119904(∘) 119867 (m) 119878 119865 Moisture Bayes Fisher LR NN RF SVM

1 27 0 0 30 30 375 26 110 Stable 209 Dry 1 1 1 1 1 12 26 0 0 306 228 306 33 270 Stable 14 Dry 1 1 1 1 1 13 2324 1915 2873 226 191 29 40 46 Failed 1 Dry 0 0 0 0 0 04 2514 2394 4788 20 30 312 65 305 Stable 136 Dry 1 1 1 1 1 15 27 0 0 15 15 43 26 60 Failed 097 Dry 0 0 0 0 0 06 26 20 20 27 27 60 70 44 Stable 235 Dry 1 1 1 0 1 17 27 0 0 20 30 375 26 50 Stable 165 Dry 1 1 1 0 1 18 27 0 0 10 10 43 26 60 Failed 064 Dry 0 0 0 0 0 09 2666 0 0 45 45 35 50 150 Stable 248 Dry 1 1 1 1 1 110 20 0 0 40 40 45 60 100 Failed 086 Dry 0 0 0 0 0 011 27 20 20 20 30 43 26 60 Stable 218 Dry 1 1 1 1 1 112 199 40 19 22 22 37 42 140 Failed 09 Dry 0 0 0 1 0 013 27 0 0 20 30 375 26 110 Stable 165 Dry 1 1 1 1 1 114 1884 0 0 30 30 375 45 61 Failed 078 Dry 0 0 0 0 0 015 1884 3007 36 30 367 375 45 61 Failed 112 Dry 0 0 0 0 0 016 2666 0 0 35 35 30 42 150 Stable 173 Dry 1 1 1 1 1 117 26 0 0 39 39 60 70 44 Failed 09 Dry 1 1 1 0 1 118 25 1436 1676 28 18 30 45 37 Failed 1 Dry 0 0 0 0 1 019 228 0 0 35 35 38 47 110 Failed 11 Dry 0 0 0 0 0 020 24 245 49 20 30 65 31 40 Stable 177 Dry 1 1 1 1 1 121 25 0 0 324 324 30 48 50 Stable 19 Dry 0 0 0 0 1 122 27 0 0 20 30 43 26 50 Stable 165 Dry 1 1 1 0 1 1

120573H

ru 120574 120601 c

(a)

120601A cA120595p

120601B cB

H120595s

120574

(b)

Figure 1 Failure models (a) circular failure mechanism and (b) wedge failure mechanism

the NBC under certain conditions even when the conditionalindependence assumption is violated

This probability calculation is straightforward condi-tioning on the observed attributes we want to find theprobability that 119868 belongs to each category that is 119875(119868 isin 119862

119894|

1198831 1198832 119883

119899)

Applying Bayesrsquo Theorem [39] this is rewritten as

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)

=119875 (119868 isin 119862

119894) 119875 (119883

1 1198832 119883

119899| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(1)

Under the mutual conditional independence assumption[39] this reduces to

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)=

119875 (119868 isin 119862119894)prod119899

119895=1119875 (119883119895| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(2)

for each category 119862119894 Since the denominator will be the same

for all categories we only need to calculate the numerator foreach category 119894 choosing

119894lowast

isin arg max119875 (119868 isin 119862119894)

119899

prod

119895=1

119875 (119883119895| 119868 isin 119862

119894) (3)

and assigning 119868 to category 119862119894lowast Then the probability that an

event 119868 belongs to category 119862119894is computed by (2)

In the present study unit weight (120574) cohesion (119888) angleof internal friction (120601) slope angle (120573) height (119867) andpore water pressure (119903

119906) for circular failure mechanism were

expressed as11988311198832119883311988341198835 and119883

6The implementation

was through the SPSS software with actual sizes of samplesas a priori probabilities and the discriminant function wasgiven as follows

119884Failed = 169401198831minus 00891119883

2minus 03232119883

3+ 06099119883

4

minus 001861198835+ 81056119883

6minus 229527

Mathematical Problems in Engineering 5

119884Stable = 190051198831minus 00341119883

2+ 00287119883

3+ 02657119883

4

minus 006031198835minus 11166119883

6minus 243608

(4)

For the case of wedge failure mechanism unit weight (120574)cohesions (119888

119860) and (119888

119861) angles of internal friction (120601

119860) and

(120601119861) angle of the line of intersection of the two joint sets (120595

119901)

slope angle (120595119904) and height (119867) are expressed as 119883

1199081 1198831199082

11988311990831198831199084119883119908511988311990861198831199087 and119883

1199088 Bayesrsquo functions are given

as follows

119884Failed = 15141198831199081

minus 0531198831199082

minus 0821198831199083

minus 1601198831199084

+ 4571198831199085

+ 1161198831199086

+ 0311198831199087

+ 0361198831199088

minus 25377

119884Stable = 17981198831199081

minus 0421198831199082

minus 1221198831199083

minus 2281198831199084

+ 5901198831199085

+ 1451198831199086

+ 0301198831199087

+ 0471198831199088

minus 36560

(5)

According to the above established models the results ofcircular failure mechanism and wedge failure mechanismcases were obtained and listed in Tables 1 and 2 respectively

25 Fisherrsquos Classification Models Fisherrsquos discriminant anal-ysis is a classification method that projects high-dimensionaldata onto a line and performs classification in this one-dimensional space which is widely used to determine whichvariable discriminates between two or more classes and toderive a classification model for predicting the group mem-bership of new observations with high accuracy [14ndash16 4344] In the present work the Fisher discriminant analysis wasused to establish discriminator for discriminating betweenfailed and stable statuses of slope

Based on the Fisher discriminant theory the score ofFisher discriminator can be calculated by

119884Fisher = 1198620+

119899

sum

119894=1

119862119894119883119894 (6)

where119862119894is the coefficient of the Fisher discriminator And the

Fisher scores of the center for failed and stable statusescan becalculated as 119884

119891and 119884

119904 respectivelyThen the threshold can

be obtained by 05(119884119891+ 119884119904) Every case has a set of values of

119883119894 and corresponding to a Fisher score if the Fisher score

is greater than the threshold the slope belongs to stable theslope otherwise to the failed slope

The indicators unit weight (120574) cohesion (119888) angle ofinternal friction (120601) slope angle (120573) height (119867) and pore

water pressure (119903119906) for circular failure mechanism are also

expressed as 1198831 1198832 1198833 1198834 1198835 and 119883

6 The calculation

was executed through the SPSS software The discriminantfunction is

119884Fisher = minus 0091198831minus 002119883

2minus 015119883

3+ 014119883

4

+ 0021198835+ 387119883

6+ 004

(7)

The 119884119891and 119884

119904are 0874 and minus1509 respectively

For the case of wedge failure mechanism as inSection 24 unit weight (120574) cohesions (119888

119860) and (119888

119861)

angles of internal friction (120601119860) and (120601

119861) angle of the line of

intersection of the two joint sets (120595119901) slope angle (120595

119904) and

height (119867) are also expressed as 1198831199081 1198831199082 1198831199083 1198831199084 1198831199085

1198831199086 1198831199087 and 119883

1199088 The Fisher discriminant function is

given as follows and the 119884119891and 119884

119904are minus2743 and 2134

respectively as

119884Fisher = 0581198831199081

minus 0021198831199082

+ 0081198831199083

minus 0141198831199084

+ 0271198831199085

+ 0061198831199086

+ 00031198831199087

+ 0021198831199088

minus 2323

(8)

According to the above established Fisher models the resultsof circular failure mechanism and wedge failure mechanismcases were also obtained and listed in Tables 1 and 2respectively

26 Logistic Regression Models Logistic regression (LR) is astatistical modeling technique in which the probability of acategory is related to a set of explanatory variables An expla-nation of logistic regression begins with an explanation of thelogistic function which always takes values between zero andoneThe logistic model is defined by the following equations

119911 = 1198860+

119899

sum

119894=1

119886119894119909119894

119875 (119911) =119890119911

1 + 119890119911

(9)

where 119911 is a measure of the contribution of the explanatoryvariables 119909

119894(119894 = 1 119899) 119886

119894are the regression coefficients

which are obtained by maximum likelihood in conjunctionwith their standard errors Δ119886

119894 and 119875(119911) is the categorical

response of variables that represents the probability of aparticular outcome In this particular application 119909

119894are

the slope rockmass parameters of interest and 119875(119911) isthe probability of having stable and failed statuses Thecalculation of LR is finished through the SPSS software andlogistic functions for circular failure mechanism and wedgefailure mechanism cases are given as follows

119875 (119911119888) =

1198900459119909

1minus0145119909

2+0515119909

3minus047119909

4minus0147119909

5minus13936119909

6minus4262

1 + 11989004591199091minus01451199092+05151199093minus0471199094minus01471199095minus139361199096minus4262

119875 (119911119908) =

1198908201119909

1199081+0567119909

1199082+0344119909

1199083minus1264119909

1199084+3185119909

1199085+0558119909

1199086minus005119909

1199087+0225119909

1199088minus30438

1 + 11989082011199091199081+05671199091199082+03441199091199083minus12641199091199084+31851199091199085+05581199091199086minus0051199091199087+02251199091199088minus30438

(10)

6 Mathematical Problems in Engineering

The threshold of the above two logistic regression models is05 and the results are listed in Tables 1 and 2

27 Neural Networks Models Neural networks (NNs) havelong been used in problems such as this with a lot of datamany variables and the possibility of noise in the data

Each input point is a high-dimensional vectorThe neuralnetwork is organized in a series of layers where the inputvector enters at the left side of the network which is thenprojected to a ldquohidden layerrdquo Each unit in the hidden layer isa weighed sum of the values in the first layer This layer thenprojects to an output layer which is where the desired answerappears

In the present work a multi-layer perceptron networkmodel is used Training took place for the specific rangeof values that cover the training dataset Trying to achievethe best networkrsquos performance several networks with dif-ferent architectures were developed using all of the possiblevariations of the backpropagation algorithms available inMATLAB 2010b The final network architecture for theprediction of safety factor against circular failure it is (6-10-1)whereas in the case of wedge failure is (8-12-1) The learningrate was set to 001 and the error goal was set to 00001The results for circular failure mechanism and wedge failuremechanism are listed in Tables 1 and 2 respectively

3 Comparisons and Discussions

The ROC curve is used to evaluate and compare the estab-lished RF SVM Bayes Fisher LR and NN classificationmodels in slope stability evaluation ROC is a graphical plotwhich illustrates the performance of a binary classifier systemas its discrimination threshold is varied [45] It is createdby plotting the fraction of true positives out of the positives(TPR = true positive rate) versus the fraction of false positivesout of the negatives (FPR = false positive rate) at variousthreshold settings

ROC analysis provides tools to select possibly optimalmodels and to discard suboptimal ones independently from(and prior to specifying) the cost context or the class distri-bution ROC analysis is related in a direct and natural way tocostbenefit analysis of diagnostic decision making

In the present study the stable and failed statuses ofslopewere considered a two-class prediction problem (binaryclassification) in which the outcomes were labeled eitheras positive (119901 stable) or negative (119899 failed) There are fourpossible outcomes from a binary classifier If the outcomefrom a prediction is 1199011015840 and the actual value is also 119901 then it iscalled true positive (TP) however if the actual value is 119899 thenit is said to be false positive (FP) Conversely a true negative(TN) value has occurred when both the prediction outcomeand the actual value are 119899 and a false negative (FN) value iswhen the prediction outcome is 1198991015840 while the actual value is 119901

An experiment from 119901 positive and 119899 negative wasdefined for instances The four outcomes can be formulatedin a 2 times 2 contingency table or a confusion matrix as followsin Table 3

Table 3 Contingency matrix for the two-class prediction problem

Actual value Total119901 119899

Predictionoutcome

1199011015840 True positive (TP) False positive (FP) 119901

1198991015840 False negative (FN) True negative (TN) 119899

Total 119901 119899

0102030405060708090

100

Bayes Fisher SVM LR NN RF TFN 3 3 4 5 3 2 0FP 2 3 0 2 1 0 0TN 27 26 29 27 28 29 29TP 14 14 13 12 14 15 17

Prop

ortio

n (

)(a)

0102030405060708090

100

Bayes Fisher SVMLR NN RF TFNFPTNTP

Prop

ortio

n (

)

1 1 1 4 0 0 01 1 1 1 2 1 09 9 9 9 8 9 10

11 11 11 8 12 12 12

(b)

Figure 2 Proportions of TP TN FP and FN for the RF SVMBayes Fisher LR and NN classification models (a) circular failuremechanism and (b) wedge failure mechanism

The specificity or the true negative rate (TNR) is definedas the percentage of slope which is correctly identified asbeing failed

Specificity = TNTN + FP

(11)

The quantity 1 minus specificity is the false positive rate and isthe percentage of slopes that are incorrectly identified asbeing stable statuses The sensitivity or the true positive rate(TPR) is defined as the percentage of slope which is correctlyidentified as being stable status

Sensitivity = TPTP + FN

(12)

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 3: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

Mathematical Problems in Engineering 3

Table 1 Samples for circular failure mechanism and results

Case no 120574 (KNm3) 119862 (kPa) Φ (∘) 120573 (∘) 119867 (m) 119903119906

119878 119865 Moisture Bayes Fisher SVM LR BP RF1 1868 2634 15 35 823 0 Failed 111 Dry 0 0 0 0 0 02 214 10 3034 30 20 0 Stable 17 Dry 1 1 1 1 1 13 23 0 20 20 100 03 Failed 12 Wet 0 0 0 0 0 04 16 70 20 40 115 0 Failed 111 Dry 0 0 0 0 0 05 1884 1436 25 20 305 045 Failed 111 Wet 0 1 0 0 0 06 20 0 36 45 50 05 Failed 067 Wet 0 0 0 0 0 07 185 12 0 30 6 0 Failed 078 Dry 0 0 0 0 0 08 22 20 36 45 50 0 Failed 102 Dry 0 0 0 0 0 09 12 0 30 35 4 0 Stable 146 Dry 0 0 1 0 1 110 2143 0 20 20 61 05 Failed 103 Wet 0 0 0 0 0 011 22 0 40 33 8 035 Stable 145 Wet 1 1 1 1 1 112 206 1628 265 30 40 0 Failed 125 Dry 1 1 0 1 0 013 18 5 30 20 8 03 Stable 205 Wet 1 1 1 1 1 114 2347 0 32 37 214 0 Failed 108 Dry 0 0 0 0 0 015 20 20 36 45 50 05 Failed 083 Wet 0 0 0 0 0 016 2041 249 13 22 1067 035 Stable 14 Wet 0 0 1 0 0 117 18 24 3015 45 20 012 Failed 112 Wet 0 0 0 0 0 018 2844 3923 38 35 100 0 Stable 199 Dry 1 1 1 1 1 119 2151 694 30 31 7681 038 Failed 101 Wet 0 0 0 0 0 020 224 10 35 45 10 04 Failed 09 Wet 0 0 0 0 0 021 14 1197 26 30 88 0 Failed 102 Dry 0 0 0 0 0 022 22 0 36 45 50 0 Failed 089 Dry 0 0 0 0 0 023 20 0 245 20 8 035 Stable 137 Wet 1 1 1 1 1 124 2844 2942 35 35 100 0 Stable 178 Dry 1 1 1 0 1 125 25 120 45 53 120 0 Stable 13 Dry 1 1 1 1 1 126 1963 1197 20 22 1219 0405 Failed 135 Wet 0 0 0 0 0 027 2041 3352 11 16 4572 02 Failed 128 Wet 0 0 0 0 0 028 224 100 45 45 15 025 Stable 18 Wet 1 1 1 1 1 129 1884 1436 25 20 305 0 Stable 1875 Dry 1 1 1 1 1 130 12 0 30 45 8 0 Failed 086 Dry 0 0 0 0 0 031 1884 1532 30 25 1067 038 Stable 163 Wet 1 1 0 1 1 032 2182 862 32 28 128 049 Failed 103 Wet 1 1 0 1 1 033 165 1149 0 30 366 0 Failed 1 Dry 0 0 0 0 0 034 906 1171 28 35 21 011 Failed 109 Wet 0 0 0 0 0 035 12 0 30 45 8 0 Failed 08 Dry 0 0 0 0 0 036 185 25 0 30 6 0 Failed 109 Dry 0 0 0 0 0 037 20 20 36 45 50 025 Failed 096 Wet 0 0 0 0 0 038 1884 5746 20 20 305 0 Stable 2045 Dry 1 1 0 1 0 039 24 0 40 33 8 03 Stable 158 Wet 1 1 0 1 1 140 26 15005 45 50 200 0 Stable 12 Dry 1 1 1 0 0 141 148 0 17 20 50 0 Failed 113 Dry 0 0 0 0 0 042 12 0 30 35 4 0 Stable 144 Dry 0 0 0 0 1 143 224 10 35 30 10 0 Stable 2 Dry 1 1 1 1 1 144 1884 0 20 20 762 045 Failed 105 Wet 0 0 0 0 0 045 20 0 36 45 50 025 Failed 079 Wet 0 0 0 0 0 046 14 1197 26 30 88 045 Failed 0625 Wet 0 0 0 0 0 0

4 Mathematical Problems in Engineering

Table 2 Samples for wedge failure mechanism and results

No 120574 (KNm3) 119888119860(KPa) 119888

119861(KPa) 120601

119860(∘) 120601

119861(∘) Ψ

119901(∘) Ψ

119904(∘) 119867 (m) 119878 119865 Moisture Bayes Fisher LR NN RF SVM

1 27 0 0 30 30 375 26 110 Stable 209 Dry 1 1 1 1 1 12 26 0 0 306 228 306 33 270 Stable 14 Dry 1 1 1 1 1 13 2324 1915 2873 226 191 29 40 46 Failed 1 Dry 0 0 0 0 0 04 2514 2394 4788 20 30 312 65 305 Stable 136 Dry 1 1 1 1 1 15 27 0 0 15 15 43 26 60 Failed 097 Dry 0 0 0 0 0 06 26 20 20 27 27 60 70 44 Stable 235 Dry 1 1 1 0 1 17 27 0 0 20 30 375 26 50 Stable 165 Dry 1 1 1 0 1 18 27 0 0 10 10 43 26 60 Failed 064 Dry 0 0 0 0 0 09 2666 0 0 45 45 35 50 150 Stable 248 Dry 1 1 1 1 1 110 20 0 0 40 40 45 60 100 Failed 086 Dry 0 0 0 0 0 011 27 20 20 20 30 43 26 60 Stable 218 Dry 1 1 1 1 1 112 199 40 19 22 22 37 42 140 Failed 09 Dry 0 0 0 1 0 013 27 0 0 20 30 375 26 110 Stable 165 Dry 1 1 1 1 1 114 1884 0 0 30 30 375 45 61 Failed 078 Dry 0 0 0 0 0 015 1884 3007 36 30 367 375 45 61 Failed 112 Dry 0 0 0 0 0 016 2666 0 0 35 35 30 42 150 Stable 173 Dry 1 1 1 1 1 117 26 0 0 39 39 60 70 44 Failed 09 Dry 1 1 1 0 1 118 25 1436 1676 28 18 30 45 37 Failed 1 Dry 0 0 0 0 1 019 228 0 0 35 35 38 47 110 Failed 11 Dry 0 0 0 0 0 020 24 245 49 20 30 65 31 40 Stable 177 Dry 1 1 1 1 1 121 25 0 0 324 324 30 48 50 Stable 19 Dry 0 0 0 0 1 122 27 0 0 20 30 43 26 50 Stable 165 Dry 1 1 1 0 1 1

120573H

ru 120574 120601 c

(a)

120601A cA120595p

120601B cB

H120595s

120574

(b)

Figure 1 Failure models (a) circular failure mechanism and (b) wedge failure mechanism

the NBC under certain conditions even when the conditionalindependence assumption is violated

This probability calculation is straightforward condi-tioning on the observed attributes we want to find theprobability that 119868 belongs to each category that is 119875(119868 isin 119862

119894|

1198831 1198832 119883

119899)

Applying Bayesrsquo Theorem [39] this is rewritten as

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)

=119875 (119868 isin 119862

119894) 119875 (119883

1 1198832 119883

119899| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(1)

Under the mutual conditional independence assumption[39] this reduces to

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)=

119875 (119868 isin 119862119894)prod119899

119895=1119875 (119883119895| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(2)

for each category 119862119894 Since the denominator will be the same

for all categories we only need to calculate the numerator foreach category 119894 choosing

119894lowast

isin arg max119875 (119868 isin 119862119894)

119899

prod

119895=1

119875 (119883119895| 119868 isin 119862

119894) (3)

and assigning 119868 to category 119862119894lowast Then the probability that an

event 119868 belongs to category 119862119894is computed by (2)

In the present study unit weight (120574) cohesion (119888) angleof internal friction (120601) slope angle (120573) height (119867) andpore water pressure (119903

119906) for circular failure mechanism were

expressed as11988311198832119883311988341198835 and119883

6The implementation

was through the SPSS software with actual sizes of samplesas a priori probabilities and the discriminant function wasgiven as follows

119884Failed = 169401198831minus 00891119883

2minus 03232119883

3+ 06099119883

4

minus 001861198835+ 81056119883

6minus 229527

Mathematical Problems in Engineering 5

119884Stable = 190051198831minus 00341119883

2+ 00287119883

3+ 02657119883

4

minus 006031198835minus 11166119883

6minus 243608

(4)

For the case of wedge failure mechanism unit weight (120574)cohesions (119888

119860) and (119888

119861) angles of internal friction (120601

119860) and

(120601119861) angle of the line of intersection of the two joint sets (120595

119901)

slope angle (120595119904) and height (119867) are expressed as 119883

1199081 1198831199082

11988311990831198831199084119883119908511988311990861198831199087 and119883

1199088 Bayesrsquo functions are given

as follows

119884Failed = 15141198831199081

minus 0531198831199082

minus 0821198831199083

minus 1601198831199084

+ 4571198831199085

+ 1161198831199086

+ 0311198831199087

+ 0361198831199088

minus 25377

119884Stable = 17981198831199081

minus 0421198831199082

minus 1221198831199083

minus 2281198831199084

+ 5901198831199085

+ 1451198831199086

+ 0301198831199087

+ 0471198831199088

minus 36560

(5)

According to the above established models the results ofcircular failure mechanism and wedge failure mechanismcases were obtained and listed in Tables 1 and 2 respectively

25 Fisherrsquos Classification Models Fisherrsquos discriminant anal-ysis is a classification method that projects high-dimensionaldata onto a line and performs classification in this one-dimensional space which is widely used to determine whichvariable discriminates between two or more classes and toderive a classification model for predicting the group mem-bership of new observations with high accuracy [14ndash16 4344] In the present work the Fisher discriminant analysis wasused to establish discriminator for discriminating betweenfailed and stable statuses of slope

Based on the Fisher discriminant theory the score ofFisher discriminator can be calculated by

119884Fisher = 1198620+

119899

sum

119894=1

119862119894119883119894 (6)

where119862119894is the coefficient of the Fisher discriminator And the

Fisher scores of the center for failed and stable statusescan becalculated as 119884

119891and 119884

119904 respectivelyThen the threshold can

be obtained by 05(119884119891+ 119884119904) Every case has a set of values of

119883119894 and corresponding to a Fisher score if the Fisher score

is greater than the threshold the slope belongs to stable theslope otherwise to the failed slope

The indicators unit weight (120574) cohesion (119888) angle ofinternal friction (120601) slope angle (120573) height (119867) and pore

water pressure (119903119906) for circular failure mechanism are also

expressed as 1198831 1198832 1198833 1198834 1198835 and 119883

6 The calculation

was executed through the SPSS software The discriminantfunction is

119884Fisher = minus 0091198831minus 002119883

2minus 015119883

3+ 014119883

4

+ 0021198835+ 387119883

6+ 004

(7)

The 119884119891and 119884

119904are 0874 and minus1509 respectively

For the case of wedge failure mechanism as inSection 24 unit weight (120574) cohesions (119888

119860) and (119888

119861)

angles of internal friction (120601119860) and (120601

119861) angle of the line of

intersection of the two joint sets (120595119901) slope angle (120595

119904) and

height (119867) are also expressed as 1198831199081 1198831199082 1198831199083 1198831199084 1198831199085

1198831199086 1198831199087 and 119883

1199088 The Fisher discriminant function is

given as follows and the 119884119891and 119884

119904are minus2743 and 2134

respectively as

119884Fisher = 0581198831199081

minus 0021198831199082

+ 0081198831199083

minus 0141198831199084

+ 0271198831199085

+ 0061198831199086

+ 00031198831199087

+ 0021198831199088

minus 2323

(8)

According to the above established Fisher models the resultsof circular failure mechanism and wedge failure mechanismcases were also obtained and listed in Tables 1 and 2respectively

26 Logistic Regression Models Logistic regression (LR) is astatistical modeling technique in which the probability of acategory is related to a set of explanatory variables An expla-nation of logistic regression begins with an explanation of thelogistic function which always takes values between zero andoneThe logistic model is defined by the following equations

119911 = 1198860+

119899

sum

119894=1

119886119894119909119894

119875 (119911) =119890119911

1 + 119890119911

(9)

where 119911 is a measure of the contribution of the explanatoryvariables 119909

119894(119894 = 1 119899) 119886

119894are the regression coefficients

which are obtained by maximum likelihood in conjunctionwith their standard errors Δ119886

119894 and 119875(119911) is the categorical

response of variables that represents the probability of aparticular outcome In this particular application 119909

119894are

the slope rockmass parameters of interest and 119875(119911) isthe probability of having stable and failed statuses Thecalculation of LR is finished through the SPSS software andlogistic functions for circular failure mechanism and wedgefailure mechanism cases are given as follows

119875 (119911119888) =

1198900459119909

1minus0145119909

2+0515119909

3minus047119909

4minus0147119909

5minus13936119909

6minus4262

1 + 11989004591199091minus01451199092+05151199093minus0471199094minus01471199095minus139361199096minus4262

119875 (119911119908) =

1198908201119909

1199081+0567119909

1199082+0344119909

1199083minus1264119909

1199084+3185119909

1199085+0558119909

1199086minus005119909

1199087+0225119909

1199088minus30438

1 + 11989082011199091199081+05671199091199082+03441199091199083minus12641199091199084+31851199091199085+05581199091199086minus0051199091199087+02251199091199088minus30438

(10)

6 Mathematical Problems in Engineering

The threshold of the above two logistic regression models is05 and the results are listed in Tables 1 and 2

27 Neural Networks Models Neural networks (NNs) havelong been used in problems such as this with a lot of datamany variables and the possibility of noise in the data

Each input point is a high-dimensional vectorThe neuralnetwork is organized in a series of layers where the inputvector enters at the left side of the network which is thenprojected to a ldquohidden layerrdquo Each unit in the hidden layer isa weighed sum of the values in the first layer This layer thenprojects to an output layer which is where the desired answerappears

In the present work a multi-layer perceptron networkmodel is used Training took place for the specific rangeof values that cover the training dataset Trying to achievethe best networkrsquos performance several networks with dif-ferent architectures were developed using all of the possiblevariations of the backpropagation algorithms available inMATLAB 2010b The final network architecture for theprediction of safety factor against circular failure it is (6-10-1)whereas in the case of wedge failure is (8-12-1) The learningrate was set to 001 and the error goal was set to 00001The results for circular failure mechanism and wedge failuremechanism are listed in Tables 1 and 2 respectively

3 Comparisons and Discussions

The ROC curve is used to evaluate and compare the estab-lished RF SVM Bayes Fisher LR and NN classificationmodels in slope stability evaluation ROC is a graphical plotwhich illustrates the performance of a binary classifier systemas its discrimination threshold is varied [45] It is createdby plotting the fraction of true positives out of the positives(TPR = true positive rate) versus the fraction of false positivesout of the negatives (FPR = false positive rate) at variousthreshold settings

ROC analysis provides tools to select possibly optimalmodels and to discard suboptimal ones independently from(and prior to specifying) the cost context or the class distri-bution ROC analysis is related in a direct and natural way tocostbenefit analysis of diagnostic decision making

In the present study the stable and failed statuses ofslopewere considered a two-class prediction problem (binaryclassification) in which the outcomes were labeled eitheras positive (119901 stable) or negative (119899 failed) There are fourpossible outcomes from a binary classifier If the outcomefrom a prediction is 1199011015840 and the actual value is also 119901 then it iscalled true positive (TP) however if the actual value is 119899 thenit is said to be false positive (FP) Conversely a true negative(TN) value has occurred when both the prediction outcomeand the actual value are 119899 and a false negative (FN) value iswhen the prediction outcome is 1198991015840 while the actual value is 119901

An experiment from 119901 positive and 119899 negative wasdefined for instances The four outcomes can be formulatedin a 2 times 2 contingency table or a confusion matrix as followsin Table 3

Table 3 Contingency matrix for the two-class prediction problem

Actual value Total119901 119899

Predictionoutcome

1199011015840 True positive (TP) False positive (FP) 119901

1198991015840 False negative (FN) True negative (TN) 119899

Total 119901 119899

0102030405060708090

100

Bayes Fisher SVM LR NN RF TFN 3 3 4 5 3 2 0FP 2 3 0 2 1 0 0TN 27 26 29 27 28 29 29TP 14 14 13 12 14 15 17

Prop

ortio

n (

)(a)

0102030405060708090

100

Bayes Fisher SVMLR NN RF TFNFPTNTP

Prop

ortio

n (

)

1 1 1 4 0 0 01 1 1 1 2 1 09 9 9 9 8 9 10

11 11 11 8 12 12 12

(b)

Figure 2 Proportions of TP TN FP and FN for the RF SVMBayes Fisher LR and NN classification models (a) circular failuremechanism and (b) wedge failure mechanism

The specificity or the true negative rate (TNR) is definedas the percentage of slope which is correctly identified asbeing failed

Specificity = TNTN + FP

(11)

The quantity 1 minus specificity is the false positive rate and isthe percentage of slopes that are incorrectly identified asbeing stable statuses The sensitivity or the true positive rate(TPR) is defined as the percentage of slope which is correctlyidentified as being stable status

Sensitivity = TPTP + FN

(12)

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 4: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

4 Mathematical Problems in Engineering

Table 2 Samples for wedge failure mechanism and results

No 120574 (KNm3) 119888119860(KPa) 119888

119861(KPa) 120601

119860(∘) 120601

119861(∘) Ψ

119901(∘) Ψ

119904(∘) 119867 (m) 119878 119865 Moisture Bayes Fisher LR NN RF SVM

1 27 0 0 30 30 375 26 110 Stable 209 Dry 1 1 1 1 1 12 26 0 0 306 228 306 33 270 Stable 14 Dry 1 1 1 1 1 13 2324 1915 2873 226 191 29 40 46 Failed 1 Dry 0 0 0 0 0 04 2514 2394 4788 20 30 312 65 305 Stable 136 Dry 1 1 1 1 1 15 27 0 0 15 15 43 26 60 Failed 097 Dry 0 0 0 0 0 06 26 20 20 27 27 60 70 44 Stable 235 Dry 1 1 1 0 1 17 27 0 0 20 30 375 26 50 Stable 165 Dry 1 1 1 0 1 18 27 0 0 10 10 43 26 60 Failed 064 Dry 0 0 0 0 0 09 2666 0 0 45 45 35 50 150 Stable 248 Dry 1 1 1 1 1 110 20 0 0 40 40 45 60 100 Failed 086 Dry 0 0 0 0 0 011 27 20 20 20 30 43 26 60 Stable 218 Dry 1 1 1 1 1 112 199 40 19 22 22 37 42 140 Failed 09 Dry 0 0 0 1 0 013 27 0 0 20 30 375 26 110 Stable 165 Dry 1 1 1 1 1 114 1884 0 0 30 30 375 45 61 Failed 078 Dry 0 0 0 0 0 015 1884 3007 36 30 367 375 45 61 Failed 112 Dry 0 0 0 0 0 016 2666 0 0 35 35 30 42 150 Stable 173 Dry 1 1 1 1 1 117 26 0 0 39 39 60 70 44 Failed 09 Dry 1 1 1 0 1 118 25 1436 1676 28 18 30 45 37 Failed 1 Dry 0 0 0 0 1 019 228 0 0 35 35 38 47 110 Failed 11 Dry 0 0 0 0 0 020 24 245 49 20 30 65 31 40 Stable 177 Dry 1 1 1 1 1 121 25 0 0 324 324 30 48 50 Stable 19 Dry 0 0 0 0 1 122 27 0 0 20 30 43 26 50 Stable 165 Dry 1 1 1 0 1 1

120573H

ru 120574 120601 c

(a)

120601A cA120595p

120601B cB

H120595s

120574

(b)

Figure 1 Failure models (a) circular failure mechanism and (b) wedge failure mechanism

the NBC under certain conditions even when the conditionalindependence assumption is violated

This probability calculation is straightforward condi-tioning on the observed attributes we want to find theprobability that 119868 belongs to each category that is 119875(119868 isin 119862

119894|

1198831 1198832 119883

119899)

Applying Bayesrsquo Theorem [39] this is rewritten as

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)

=119875 (119868 isin 119862

119894) 119875 (119883

1 1198832 119883

119899| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(1)

Under the mutual conditional independence assumption[39] this reduces to

119875 (119868 isin 119862119894| 1198831 1198832 119883

119899)=

119875 (119868 isin 119862119894)prod119899

119895=1119875 (119883119895| 119868 isin 119862

119894)

119875 (1198831 1198832 119883

119899)

(2)

for each category 119862119894 Since the denominator will be the same

for all categories we only need to calculate the numerator foreach category 119894 choosing

119894lowast

isin arg max119875 (119868 isin 119862119894)

119899

prod

119895=1

119875 (119883119895| 119868 isin 119862

119894) (3)

and assigning 119868 to category 119862119894lowast Then the probability that an

event 119868 belongs to category 119862119894is computed by (2)

In the present study unit weight (120574) cohesion (119888) angleof internal friction (120601) slope angle (120573) height (119867) andpore water pressure (119903

119906) for circular failure mechanism were

expressed as11988311198832119883311988341198835 and119883

6The implementation

was through the SPSS software with actual sizes of samplesas a priori probabilities and the discriminant function wasgiven as follows

119884Failed = 169401198831minus 00891119883

2minus 03232119883

3+ 06099119883

4

minus 001861198835+ 81056119883

6minus 229527

Mathematical Problems in Engineering 5

119884Stable = 190051198831minus 00341119883

2+ 00287119883

3+ 02657119883

4

minus 006031198835minus 11166119883

6minus 243608

(4)

For the case of wedge failure mechanism unit weight (120574)cohesions (119888

119860) and (119888

119861) angles of internal friction (120601

119860) and

(120601119861) angle of the line of intersection of the two joint sets (120595

119901)

slope angle (120595119904) and height (119867) are expressed as 119883

1199081 1198831199082

11988311990831198831199084119883119908511988311990861198831199087 and119883

1199088 Bayesrsquo functions are given

as follows

119884Failed = 15141198831199081

minus 0531198831199082

minus 0821198831199083

minus 1601198831199084

+ 4571198831199085

+ 1161198831199086

+ 0311198831199087

+ 0361198831199088

minus 25377

119884Stable = 17981198831199081

minus 0421198831199082

minus 1221198831199083

minus 2281198831199084

+ 5901198831199085

+ 1451198831199086

+ 0301198831199087

+ 0471198831199088

minus 36560

(5)

According to the above established models the results ofcircular failure mechanism and wedge failure mechanismcases were obtained and listed in Tables 1 and 2 respectively

25 Fisherrsquos Classification Models Fisherrsquos discriminant anal-ysis is a classification method that projects high-dimensionaldata onto a line and performs classification in this one-dimensional space which is widely used to determine whichvariable discriminates between two or more classes and toderive a classification model for predicting the group mem-bership of new observations with high accuracy [14ndash16 4344] In the present work the Fisher discriminant analysis wasused to establish discriminator for discriminating betweenfailed and stable statuses of slope

Based on the Fisher discriminant theory the score ofFisher discriminator can be calculated by

119884Fisher = 1198620+

119899

sum

119894=1

119862119894119883119894 (6)

where119862119894is the coefficient of the Fisher discriminator And the

Fisher scores of the center for failed and stable statusescan becalculated as 119884

119891and 119884

119904 respectivelyThen the threshold can

be obtained by 05(119884119891+ 119884119904) Every case has a set of values of

119883119894 and corresponding to a Fisher score if the Fisher score

is greater than the threshold the slope belongs to stable theslope otherwise to the failed slope

The indicators unit weight (120574) cohesion (119888) angle ofinternal friction (120601) slope angle (120573) height (119867) and pore

water pressure (119903119906) for circular failure mechanism are also

expressed as 1198831 1198832 1198833 1198834 1198835 and 119883

6 The calculation

was executed through the SPSS software The discriminantfunction is

119884Fisher = minus 0091198831minus 002119883

2minus 015119883

3+ 014119883

4

+ 0021198835+ 387119883

6+ 004

(7)

The 119884119891and 119884

119904are 0874 and minus1509 respectively

For the case of wedge failure mechanism as inSection 24 unit weight (120574) cohesions (119888

119860) and (119888

119861)

angles of internal friction (120601119860) and (120601

119861) angle of the line of

intersection of the two joint sets (120595119901) slope angle (120595

119904) and

height (119867) are also expressed as 1198831199081 1198831199082 1198831199083 1198831199084 1198831199085

1198831199086 1198831199087 and 119883

1199088 The Fisher discriminant function is

given as follows and the 119884119891and 119884

119904are minus2743 and 2134

respectively as

119884Fisher = 0581198831199081

minus 0021198831199082

+ 0081198831199083

minus 0141198831199084

+ 0271198831199085

+ 0061198831199086

+ 00031198831199087

+ 0021198831199088

minus 2323

(8)

According to the above established Fisher models the resultsof circular failure mechanism and wedge failure mechanismcases were also obtained and listed in Tables 1 and 2respectively

26 Logistic Regression Models Logistic regression (LR) is astatistical modeling technique in which the probability of acategory is related to a set of explanatory variables An expla-nation of logistic regression begins with an explanation of thelogistic function which always takes values between zero andoneThe logistic model is defined by the following equations

119911 = 1198860+

119899

sum

119894=1

119886119894119909119894

119875 (119911) =119890119911

1 + 119890119911

(9)

where 119911 is a measure of the contribution of the explanatoryvariables 119909

119894(119894 = 1 119899) 119886

119894are the regression coefficients

which are obtained by maximum likelihood in conjunctionwith their standard errors Δ119886

119894 and 119875(119911) is the categorical

response of variables that represents the probability of aparticular outcome In this particular application 119909

119894are

the slope rockmass parameters of interest and 119875(119911) isthe probability of having stable and failed statuses Thecalculation of LR is finished through the SPSS software andlogistic functions for circular failure mechanism and wedgefailure mechanism cases are given as follows

119875 (119911119888) =

1198900459119909

1minus0145119909

2+0515119909

3minus047119909

4minus0147119909

5minus13936119909

6minus4262

1 + 11989004591199091minus01451199092+05151199093minus0471199094minus01471199095minus139361199096minus4262

119875 (119911119908) =

1198908201119909

1199081+0567119909

1199082+0344119909

1199083minus1264119909

1199084+3185119909

1199085+0558119909

1199086minus005119909

1199087+0225119909

1199088minus30438

1 + 11989082011199091199081+05671199091199082+03441199091199083minus12641199091199084+31851199091199085+05581199091199086minus0051199091199087+02251199091199088minus30438

(10)

6 Mathematical Problems in Engineering

The threshold of the above two logistic regression models is05 and the results are listed in Tables 1 and 2

27 Neural Networks Models Neural networks (NNs) havelong been used in problems such as this with a lot of datamany variables and the possibility of noise in the data

Each input point is a high-dimensional vectorThe neuralnetwork is organized in a series of layers where the inputvector enters at the left side of the network which is thenprojected to a ldquohidden layerrdquo Each unit in the hidden layer isa weighed sum of the values in the first layer This layer thenprojects to an output layer which is where the desired answerappears

In the present work a multi-layer perceptron networkmodel is used Training took place for the specific rangeof values that cover the training dataset Trying to achievethe best networkrsquos performance several networks with dif-ferent architectures were developed using all of the possiblevariations of the backpropagation algorithms available inMATLAB 2010b The final network architecture for theprediction of safety factor against circular failure it is (6-10-1)whereas in the case of wedge failure is (8-12-1) The learningrate was set to 001 and the error goal was set to 00001The results for circular failure mechanism and wedge failuremechanism are listed in Tables 1 and 2 respectively

3 Comparisons and Discussions

The ROC curve is used to evaluate and compare the estab-lished RF SVM Bayes Fisher LR and NN classificationmodels in slope stability evaluation ROC is a graphical plotwhich illustrates the performance of a binary classifier systemas its discrimination threshold is varied [45] It is createdby plotting the fraction of true positives out of the positives(TPR = true positive rate) versus the fraction of false positivesout of the negatives (FPR = false positive rate) at variousthreshold settings

ROC analysis provides tools to select possibly optimalmodels and to discard suboptimal ones independently from(and prior to specifying) the cost context or the class distri-bution ROC analysis is related in a direct and natural way tocostbenefit analysis of diagnostic decision making

In the present study the stable and failed statuses ofslopewere considered a two-class prediction problem (binaryclassification) in which the outcomes were labeled eitheras positive (119901 stable) or negative (119899 failed) There are fourpossible outcomes from a binary classifier If the outcomefrom a prediction is 1199011015840 and the actual value is also 119901 then it iscalled true positive (TP) however if the actual value is 119899 thenit is said to be false positive (FP) Conversely a true negative(TN) value has occurred when both the prediction outcomeand the actual value are 119899 and a false negative (FN) value iswhen the prediction outcome is 1198991015840 while the actual value is 119901

An experiment from 119901 positive and 119899 negative wasdefined for instances The four outcomes can be formulatedin a 2 times 2 contingency table or a confusion matrix as followsin Table 3

Table 3 Contingency matrix for the two-class prediction problem

Actual value Total119901 119899

Predictionoutcome

1199011015840 True positive (TP) False positive (FP) 119901

1198991015840 False negative (FN) True negative (TN) 119899

Total 119901 119899

0102030405060708090

100

Bayes Fisher SVM LR NN RF TFN 3 3 4 5 3 2 0FP 2 3 0 2 1 0 0TN 27 26 29 27 28 29 29TP 14 14 13 12 14 15 17

Prop

ortio

n (

)(a)

0102030405060708090

100

Bayes Fisher SVMLR NN RF TFNFPTNTP

Prop

ortio

n (

)

1 1 1 4 0 0 01 1 1 1 2 1 09 9 9 9 8 9 10

11 11 11 8 12 12 12

(b)

Figure 2 Proportions of TP TN FP and FN for the RF SVMBayes Fisher LR and NN classification models (a) circular failuremechanism and (b) wedge failure mechanism

The specificity or the true negative rate (TNR) is definedas the percentage of slope which is correctly identified asbeing failed

Specificity = TNTN + FP

(11)

The quantity 1 minus specificity is the false positive rate and isthe percentage of slopes that are incorrectly identified asbeing stable statuses The sensitivity or the true positive rate(TPR) is defined as the percentage of slope which is correctlyidentified as being stable status

Sensitivity = TPTP + FN

(12)

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 5: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

Mathematical Problems in Engineering 5

119884Stable = 190051198831minus 00341119883

2+ 00287119883

3+ 02657119883

4

minus 006031198835minus 11166119883

6minus 243608

(4)

For the case of wedge failure mechanism unit weight (120574)cohesions (119888

119860) and (119888

119861) angles of internal friction (120601

119860) and

(120601119861) angle of the line of intersection of the two joint sets (120595

119901)

slope angle (120595119904) and height (119867) are expressed as 119883

1199081 1198831199082

11988311990831198831199084119883119908511988311990861198831199087 and119883

1199088 Bayesrsquo functions are given

as follows

119884Failed = 15141198831199081

minus 0531198831199082

minus 0821198831199083

minus 1601198831199084

+ 4571198831199085

+ 1161198831199086

+ 0311198831199087

+ 0361198831199088

minus 25377

119884Stable = 17981198831199081

minus 0421198831199082

minus 1221198831199083

minus 2281198831199084

+ 5901198831199085

+ 1451198831199086

+ 0301198831199087

+ 0471198831199088

minus 36560

(5)

According to the above established models the results ofcircular failure mechanism and wedge failure mechanismcases were obtained and listed in Tables 1 and 2 respectively

25 Fisherrsquos Classification Models Fisherrsquos discriminant anal-ysis is a classification method that projects high-dimensionaldata onto a line and performs classification in this one-dimensional space which is widely used to determine whichvariable discriminates between two or more classes and toderive a classification model for predicting the group mem-bership of new observations with high accuracy [14ndash16 4344] In the present work the Fisher discriminant analysis wasused to establish discriminator for discriminating betweenfailed and stable statuses of slope

Based on the Fisher discriminant theory the score ofFisher discriminator can be calculated by

119884Fisher = 1198620+

119899

sum

119894=1

119862119894119883119894 (6)

where119862119894is the coefficient of the Fisher discriminator And the

Fisher scores of the center for failed and stable statusescan becalculated as 119884

119891and 119884

119904 respectivelyThen the threshold can

be obtained by 05(119884119891+ 119884119904) Every case has a set of values of

119883119894 and corresponding to a Fisher score if the Fisher score

is greater than the threshold the slope belongs to stable theslope otherwise to the failed slope

The indicators unit weight (120574) cohesion (119888) angle ofinternal friction (120601) slope angle (120573) height (119867) and pore

water pressure (119903119906) for circular failure mechanism are also

expressed as 1198831 1198832 1198833 1198834 1198835 and 119883

6 The calculation

was executed through the SPSS software The discriminantfunction is

119884Fisher = minus 0091198831minus 002119883

2minus 015119883

3+ 014119883

4

+ 0021198835+ 387119883

6+ 004

(7)

The 119884119891and 119884

119904are 0874 and minus1509 respectively

For the case of wedge failure mechanism as inSection 24 unit weight (120574) cohesions (119888

119860) and (119888

119861)

angles of internal friction (120601119860) and (120601

119861) angle of the line of

intersection of the two joint sets (120595119901) slope angle (120595

119904) and

height (119867) are also expressed as 1198831199081 1198831199082 1198831199083 1198831199084 1198831199085

1198831199086 1198831199087 and 119883

1199088 The Fisher discriminant function is

given as follows and the 119884119891and 119884

119904are minus2743 and 2134

respectively as

119884Fisher = 0581198831199081

minus 0021198831199082

+ 0081198831199083

minus 0141198831199084

+ 0271198831199085

+ 0061198831199086

+ 00031198831199087

+ 0021198831199088

minus 2323

(8)

According to the above established Fisher models the resultsof circular failure mechanism and wedge failure mechanismcases were also obtained and listed in Tables 1 and 2respectively

26 Logistic Regression Models Logistic regression (LR) is astatistical modeling technique in which the probability of acategory is related to a set of explanatory variables An expla-nation of logistic regression begins with an explanation of thelogistic function which always takes values between zero andoneThe logistic model is defined by the following equations

119911 = 1198860+

119899

sum

119894=1

119886119894119909119894

119875 (119911) =119890119911

1 + 119890119911

(9)

where 119911 is a measure of the contribution of the explanatoryvariables 119909

119894(119894 = 1 119899) 119886

119894are the regression coefficients

which are obtained by maximum likelihood in conjunctionwith their standard errors Δ119886

119894 and 119875(119911) is the categorical

response of variables that represents the probability of aparticular outcome In this particular application 119909

119894are

the slope rockmass parameters of interest and 119875(119911) isthe probability of having stable and failed statuses Thecalculation of LR is finished through the SPSS software andlogistic functions for circular failure mechanism and wedgefailure mechanism cases are given as follows

119875 (119911119888) =

1198900459119909

1minus0145119909

2+0515119909

3minus047119909

4minus0147119909

5minus13936119909

6minus4262

1 + 11989004591199091minus01451199092+05151199093minus0471199094minus01471199095minus139361199096minus4262

119875 (119911119908) =

1198908201119909

1199081+0567119909

1199082+0344119909

1199083minus1264119909

1199084+3185119909

1199085+0558119909

1199086minus005119909

1199087+0225119909

1199088minus30438

1 + 11989082011199091199081+05671199091199082+03441199091199083minus12641199091199084+31851199091199085+05581199091199086minus0051199091199087+02251199091199088minus30438

(10)

6 Mathematical Problems in Engineering

The threshold of the above two logistic regression models is05 and the results are listed in Tables 1 and 2

27 Neural Networks Models Neural networks (NNs) havelong been used in problems such as this with a lot of datamany variables and the possibility of noise in the data

Each input point is a high-dimensional vectorThe neuralnetwork is organized in a series of layers where the inputvector enters at the left side of the network which is thenprojected to a ldquohidden layerrdquo Each unit in the hidden layer isa weighed sum of the values in the first layer This layer thenprojects to an output layer which is where the desired answerappears

In the present work a multi-layer perceptron networkmodel is used Training took place for the specific rangeof values that cover the training dataset Trying to achievethe best networkrsquos performance several networks with dif-ferent architectures were developed using all of the possiblevariations of the backpropagation algorithms available inMATLAB 2010b The final network architecture for theprediction of safety factor against circular failure it is (6-10-1)whereas in the case of wedge failure is (8-12-1) The learningrate was set to 001 and the error goal was set to 00001The results for circular failure mechanism and wedge failuremechanism are listed in Tables 1 and 2 respectively

3 Comparisons and Discussions

The ROC curve is used to evaluate and compare the estab-lished RF SVM Bayes Fisher LR and NN classificationmodels in slope stability evaluation ROC is a graphical plotwhich illustrates the performance of a binary classifier systemas its discrimination threshold is varied [45] It is createdby plotting the fraction of true positives out of the positives(TPR = true positive rate) versus the fraction of false positivesout of the negatives (FPR = false positive rate) at variousthreshold settings

ROC analysis provides tools to select possibly optimalmodels and to discard suboptimal ones independently from(and prior to specifying) the cost context or the class distri-bution ROC analysis is related in a direct and natural way tocostbenefit analysis of diagnostic decision making

In the present study the stable and failed statuses ofslopewere considered a two-class prediction problem (binaryclassification) in which the outcomes were labeled eitheras positive (119901 stable) or negative (119899 failed) There are fourpossible outcomes from a binary classifier If the outcomefrom a prediction is 1199011015840 and the actual value is also 119901 then it iscalled true positive (TP) however if the actual value is 119899 thenit is said to be false positive (FP) Conversely a true negative(TN) value has occurred when both the prediction outcomeand the actual value are 119899 and a false negative (FN) value iswhen the prediction outcome is 1198991015840 while the actual value is 119901

An experiment from 119901 positive and 119899 negative wasdefined for instances The four outcomes can be formulatedin a 2 times 2 contingency table or a confusion matrix as followsin Table 3

Table 3 Contingency matrix for the two-class prediction problem

Actual value Total119901 119899

Predictionoutcome

1199011015840 True positive (TP) False positive (FP) 119901

1198991015840 False negative (FN) True negative (TN) 119899

Total 119901 119899

0102030405060708090

100

Bayes Fisher SVM LR NN RF TFN 3 3 4 5 3 2 0FP 2 3 0 2 1 0 0TN 27 26 29 27 28 29 29TP 14 14 13 12 14 15 17

Prop

ortio

n (

)(a)

0102030405060708090

100

Bayes Fisher SVMLR NN RF TFNFPTNTP

Prop

ortio

n (

)

1 1 1 4 0 0 01 1 1 1 2 1 09 9 9 9 8 9 10

11 11 11 8 12 12 12

(b)

Figure 2 Proportions of TP TN FP and FN for the RF SVMBayes Fisher LR and NN classification models (a) circular failuremechanism and (b) wedge failure mechanism

The specificity or the true negative rate (TNR) is definedas the percentage of slope which is correctly identified asbeing failed

Specificity = TNTN + FP

(11)

The quantity 1 minus specificity is the false positive rate and isthe percentage of slopes that are incorrectly identified asbeing stable statuses The sensitivity or the true positive rate(TPR) is defined as the percentage of slope which is correctlyidentified as being stable status

Sensitivity = TPTP + FN

(12)

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 6: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

6 Mathematical Problems in Engineering

The threshold of the above two logistic regression models is05 and the results are listed in Tables 1 and 2

27 Neural Networks Models Neural networks (NNs) havelong been used in problems such as this with a lot of datamany variables and the possibility of noise in the data

Each input point is a high-dimensional vectorThe neuralnetwork is organized in a series of layers where the inputvector enters at the left side of the network which is thenprojected to a ldquohidden layerrdquo Each unit in the hidden layer isa weighed sum of the values in the first layer This layer thenprojects to an output layer which is where the desired answerappears

In the present work a multi-layer perceptron networkmodel is used Training took place for the specific rangeof values that cover the training dataset Trying to achievethe best networkrsquos performance several networks with dif-ferent architectures were developed using all of the possiblevariations of the backpropagation algorithms available inMATLAB 2010b The final network architecture for theprediction of safety factor against circular failure it is (6-10-1)whereas in the case of wedge failure is (8-12-1) The learningrate was set to 001 and the error goal was set to 00001The results for circular failure mechanism and wedge failuremechanism are listed in Tables 1 and 2 respectively

3 Comparisons and Discussions

The ROC curve is used to evaluate and compare the estab-lished RF SVM Bayes Fisher LR and NN classificationmodels in slope stability evaluation ROC is a graphical plotwhich illustrates the performance of a binary classifier systemas its discrimination threshold is varied [45] It is createdby plotting the fraction of true positives out of the positives(TPR = true positive rate) versus the fraction of false positivesout of the negatives (FPR = false positive rate) at variousthreshold settings

ROC analysis provides tools to select possibly optimalmodels and to discard suboptimal ones independently from(and prior to specifying) the cost context or the class distri-bution ROC analysis is related in a direct and natural way tocostbenefit analysis of diagnostic decision making

In the present study the stable and failed statuses ofslopewere considered a two-class prediction problem (binaryclassification) in which the outcomes were labeled eitheras positive (119901 stable) or negative (119899 failed) There are fourpossible outcomes from a binary classifier If the outcomefrom a prediction is 1199011015840 and the actual value is also 119901 then it iscalled true positive (TP) however if the actual value is 119899 thenit is said to be false positive (FP) Conversely a true negative(TN) value has occurred when both the prediction outcomeand the actual value are 119899 and a false negative (FN) value iswhen the prediction outcome is 1198991015840 while the actual value is 119901

An experiment from 119901 positive and 119899 negative wasdefined for instances The four outcomes can be formulatedin a 2 times 2 contingency table or a confusion matrix as followsin Table 3

Table 3 Contingency matrix for the two-class prediction problem

Actual value Total119901 119899

Predictionoutcome

1199011015840 True positive (TP) False positive (FP) 119901

1198991015840 False negative (FN) True negative (TN) 119899

Total 119901 119899

0102030405060708090

100

Bayes Fisher SVM LR NN RF TFN 3 3 4 5 3 2 0FP 2 3 0 2 1 0 0TN 27 26 29 27 28 29 29TP 14 14 13 12 14 15 17

Prop

ortio

n (

)(a)

0102030405060708090

100

Bayes Fisher SVMLR NN RF TFNFPTNTP

Prop

ortio

n (

)

1 1 1 4 0 0 01 1 1 1 2 1 09 9 9 9 8 9 10

11 11 11 8 12 12 12

(b)

Figure 2 Proportions of TP TN FP and FN for the RF SVMBayes Fisher LR and NN classification models (a) circular failuremechanism and (b) wedge failure mechanism

The specificity or the true negative rate (TNR) is definedas the percentage of slope which is correctly identified asbeing failed

Specificity = TNTN + FP

(11)

The quantity 1 minus specificity is the false positive rate and isthe percentage of slopes that are incorrectly identified asbeing stable statuses The sensitivity or the true positive rate(TPR) is defined as the percentage of slope which is correctlyidentified as being stable status

Sensitivity = TPTP + FN

(12)

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 7: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

Mathematical Problems in Engineering 7

10

08

06

04

02

00

100806040200

Sens

itivi

ty

minus02

BayesFisher

ReferenceSVMLR

NNRF

1 minus specificity

(a)

10

08

06

04

02

00100806040200

Sens

itivi

tyBayesFisher

ReferenceSVM

LRNN

RF1 minus specificity

(b)

Figure 3 ROC curves for the RF SVM Bayes Fisher LR and NN classification models (a) circular failure mechanism and (b) wedge failuremechanism

Table 4 Areas under ROC curves for cases of circular failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0877 0061 00000 07573 09973Fisher 0860 0064 00001 07355 09846SVM 0882 0064 00000 07579 10000LR 0819 0073 00004 06757 09612BP 0895 0059 00000 07794 10000RF 0941 0047 00000 08497 10000

For the cases of circular failure mechanism the proportionsof TP TN FP and FN for the RF SVM Bayes FisherLR and NN classification models are shown in Figure 2(a)ROC curves are shown in Figure 3(a) And the areas underthe ROC curves of RF SVM Bayes Fisher LR and NNclassification models are listed in Table 4 Figure 2(a) showsthat the accuracy of RF model is the highest with the TP of 15and TN of 29 Figure 3(a) and Table 4 show that RF has thebiggest area (0941) followed by NN (0895) SVM (0882)Bayes (0877) Fisher (0860) and LR (0819) For the casesof wedge failure mechanism the proportions of TP TN FPand FN for RF SVM Bayes Fisher LR and NN classifiers areshown in Figure 2(b) ROC curves are shown in Figure 3(b)And the areas under ROC curves of RF SVM Bayes FisherLR and NN classifiers are listed in Table 5 Figure 2(b) showsthat the accuracy of SVMmodels is the highest with the TP of12 andTNof 9 Figure 3(b) andTable 5 show that SVMhas the

biggest area (095) and followed by Bayesrsquo and Fishermodelsand LR which have the same area (0908) and then followedby RF (09) and NN (0783) Figures 2(a) and 2(b) clearlyshow that both the RF and SVM models have the highestTP and TN It is suggested that the evaluated methods fordifferent failure mechanism slopes are different and RF andSVM models can be the preferred ones for circular failureand wedge failure landslides respectively It is noted thatthe trained and calibrated models are influenced by the sizeof training samples and the reliability and applicability ofthe proposed models in this paper can be improved withincreasing training samples

4 Conclusions

This paper demonstrates the applicability and feasibility ofthe RF SVM Bayes (NBC) Fisher LR and NN classification

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 8: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

8 Mathematical Problems in Engineering

Table 5 Areas under ROC curves for cases of wedge failure mechanism

Methods Areas Standard error 119875 value 95 confidence intervalUpper Lower

Bayes 0908 0073 00010 07650 1000Fisher 0908 0073 00010 07650 1000LR 0908 0073 00010 07650 1000NN 0783 0102 00250 05830 0984RF 0900 0079 00020 07460 1000SVM 0950 0057 00000 08380 1000

models to evaluate the rockmass stability of slopes Samplesof both circular failure mechanism and wedge failure mecha-nism were considered to establish and calibrate discriminantmodels The classification performances of different model-ing approaches are analyzed and compared by ROC curvesResults show that the established RF SVM Bayes Fisher LRand NN classification models can evaluate the slope statuseswith a high accuracy RF models have the highest accuracyfor slope cases for circular failure mechanism while SVMmodels have the highest accuracy for slope cases for wedgefailure mechanism Both the RF and SVM models have thehighest TP andTN It is suggested that the establishedmodelsfor different failure mechanism slopes are different and RFand SVM models can be the preferred ones for evaluatingthe stability of circular failure and wedge failure landslidesrespectively

Conflict of Interests

The authors declare that there is no conflict of interestsregarding the publication of this paper

Acknowledgments

The support of the National Natural Science Foundation ofChina (50934006) National Basic Research (973) Programof China (2010CB732004) China Scholarship Council Doc-toral Candidate Innovation Research Support Program byScience amp Technology Review (kjdb201001-7) and Scholar-ship Award for Excellent Doctoral Student from Ministry ofEducation of China is gratefully acknowledged

References

[1] M G Sakellariou and M D Ferentinou ldquoA study of slopestability prediction using neural networksrdquo Geotechnical andGeological Engineering vol 23 no 4 pp 419ndash445 2005

[2] L-J Dong and X-B Li ldquoInterval non-probabilistic reliabilitymethod for surrounding jointed rock mass stability of under-ground cavernsrdquo Chinese Journal of Geotechnical Engineeringvol 33 no 7 pp 1007ndash1013 2011

[3] L-J Dong and X-B Li ldquoInterval parameters and credibility ofrepresentative values of tensile and compression strength testson rockrdquo Chinese Journal of Geotechnical Engineering vol 32no 12 pp 1969ndash1974 2010

[4] L Dong X Li and Z Zhou ldquoNonlinear model-based supportvector machine for predicting rock mechanical behaviorsrdquoAdvanced Science Letters vol 5 pp 806ndash810 2012

[5] B Rajesh Kumar H Vardhan M Govindaraj and G VijayldquoRegression analysis and ANN models to predict rock proper-ties from sound levels produced during drillingrdquo InternationalJournal of Rock Mechanics and Mining Sciences vol 58 pp 61ndash72 2013

[6] S Kundu A Saha D Sharma and C Pant ldquoRemote sensingand GIS based landslide susceptibility assessment using binarylogistic regression model a case study in the GaneshgangaWatershed Himalayasrdquo Journal of the Indian Society of RemoteSensing 2013

[7] H R Pourghasemi A G Jirandeh B Pradhan C Xu andC Gokceoglu ldquoLandslide susceptibility mapping using supportvector machine and GIS at the Golestan Province Iranrdquo Journalof Earth System Science vol 122 no 2 pp 349ndash369 2013

[8] S Pascale S Parisi A Mancini et al ldquoLandslide susceptibilitymapping using artificial neural network in the urban area ofSenise and San Costantino Albanese (Basilicata Southern Ita-ly)rdquo in Computational Science and Its ApplicationsmdashICCSA2013 pp 473ndash488 Springer 2013

[9] H Wang J Li B Zhou Z Yuan and Y Chen ldquoApplicationof a hybrid model of neural networks and genetic algorithmsto evaluate landslide susceptibilityrdquo Natural Hazards and EarthSystem Sciences Discussions vol 1 pp 353ndash388 2013

[10] M Venkatesan A Thangavelu and P Prabhavathy ldquoAnimproved Bayesian classification data mining method for earlywarning landslide susceptibility model using GISrdquo in Proceed-ings of the 7th International Conference on Bio-Inspired Comput-ing Theories and Applications (BIC-TA rsquo12) pp 277ndash288 2013

[11] D T Bui B Pradhan O Lofman I Revhaug and Oslash B DickldquoRegional prediction of landslide hazard using probability anal-ysis of intense rainfall in the Hoa Binh province VietnamrdquoNat-ural Hazards vol 66 no 2 pp 707ndash730 2013

[12] L Dong X Li and K Peng ldquoPrediction of rockburst classifica-tion using Random Forestrdquo Transactions of Nonferrous MetalsSociety of China vol 23 pp 472ndash477 2013

[13] A C Adoko C Gokceoglu L Wu and Q J Zuo ldquoKnowledge-based and data-driven fuzzy modeling for rockburst predic-tionrdquo International Journal of RockMechanics andMining Scien-ces vol 61 pp 86ndash95 2013

[14] L Dong X Li G Zhao and F Gong ldquoFisher discriminantanalysis model and its application to predicting destructiveeffect of masonry structure under blasting vibration of open-pit minerdquo Chinese Journal of Rock Mechanics and Engineeringvol 28 no 4 pp 750ndash756 2009

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 9: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

Mathematical Problems in Engineering 9

[15] L J Dong F Y Wang Y F Bai and Y F Liu ldquoA Fisher dis-criminant analysis model for prediction of seismic liquefactionof sand soilrdquo Near-Surface Geophysics and Human Activity pp146ndash150 2008

[16] L J Dong YH Fu Y F Liu andY F Bai ldquoAFisher discriminantanalysismodel for classification of rocks surrounding in tunnelrdquoin Proceedings of the Information Technology and EnvironmentalSystem Sciences (Itess rsquo08) vol 2 pp 632ndash636 2008

[17] L J Dong D T Hu Y F Bai and Y F Liu ldquoUnascertainedaverage grade model for surrounding rock classification onhydraulic tunnelsrdquo Progress in Safety Science and Technologyvol 7 pp 2227ndash2231 2008

[18] L-J Dong X-B Li and Y-F Bai ldquoA Fisher discriminant analy-sis model for classifying top coal cavability of the steep seamrdquoJournal of the China Coal Society vol 34 no 1 pp 58ndash63 2009

[19] L Dong and F Wang ldquoComprehensive evaluation seismic sta-bility of slopes based on unascermined measurcmemrdquoThe Chi-nese Journal of Geological Hazard and Control vol 18 pp 74ndash782007

[20] L Dong and X Li ldquoAn application of grey-general regressionneural network for predicting landslide deformation of DahuMine in Chinardquo Advanced Science Letters vol 6 pp 577ndash5812012

[21] X B Li L J Dong G Y Zhao et al ldquoStability analysis andcomprehensive treatmentmethods of landslides under complexmining environment-A case study of Dahu landslide fromLinbao Henan in Chinardquo Safety Science vol 50 no 4 pp 695ndash704 2012

[22] T N Singh R Kanchan K Saigal andA K Verma ldquoPredictionof p-wave velocity and anisotropic property of rock usingartificial neural network techniquerdquo Journal of Scientific andIndustrial Research vol 63 no 1 pp 32ndash38 2004

[23] H Vardhan G R Adhikari and M Govinda Raj ldquoEstimatingrock properties using sound levels produced during drillingrdquoInternational Journal of Rock Mechanics and Mining Sciencesvol 46 no 3 pp 604ndash612 2009

[24] R Huang J Huang N Ju and Y Li ldquoAutomated tunnelrock classification using rock engineering systemsrdquo EngineeringGeology vol 156 pp 20ndash27 2013

[25] A Khabbazi M Ghafoori G Lashkaripour and A CheshomildquoEstimation of the rockmass deformationmodulus using a rockclassification systemrdquoGeomechanics and Geoengineering vol 8pp 46ndash52 2013

[26] K Manoj and M Monjezi ldquoPrediction of flyrock in open pitblasting operation using machine learning methodrdquo Interna-tional Journal of Mining Science and Technology vol 23 no 3pp 313ndash316 2013

[27] LDong X LiMXu andQ Li ldquoComparisons of random forestand support vector machine for predicting blasting vibrationcharacteristic parametersrdquo in Proceedings of the 1st InternationalSymposium on Mine Safety Science and Engineering (ISMSSErsquo11) vol 26 pp 1772ndash1781 October 2011

[28] A Salimi and M Esmaeili ldquoUtilising of linear and non-linearprediction tools for evaluation of penetration rate of tunnelboring machine in hard rock conditionrdquo International Journalof Mining and Mineral Engineering vol 4 pp 249ndash264 2013

[29] AVerma andT Singh ldquoComparative study of cognitive systemsfor ground vibration measurementsrdquo Neural Computing andApplications vol 22 no 1 supplement pp 341ndash350 2013

[30] A K Verma and T N Singh ldquoA neuro-fuzzy approach for pre-diction of longitudinal wave velocityrdquo Neural Computing andApplications vol 22 no 7-8 pp 1685ndash1693 2013

[31] J Xing A Jiang Z Wen and J Qin ldquoA nonlinear optimizationtechnique of tunnel construction based on DE and LSSVMrdquoMathematical Problems in Engineering vol 2013 Article ID980154 11 pages 2013

[32] O Saeidi S R Torabi and M Ataei ldquoPrediction of the rockmass diggability index by using fuzzy clustering-based ANNand multiple regression methodsrdquo Rock Mechanics and RockEngineering 2013

[33] T Wang L Cai Y Fu and T Zhu ldquoA wavelet-based robustrelevance vector machine based on sensor data schedulingcontrol for modeling mine gas gushing forecasting on virtualenvironmentrdquoMathematical Problems in Engineering vol 2013Article ID 579693 4 pages 2013

[34] Y L Tsai ldquoRainfall reliability evaluation for stability of munic-ipal solid waste landfills on sloperdquo Mathematical Problems inEngineering vol 2013 Article ID 653282 10 pages 2013

[35] P Samui and D Kim ldquoDetermination of reservoir inducedearthquake using support vectormachine andGaussian processregressionrdquo Applied Geophysics vol 10 pp 229ndash234 2013

[36] L Dong X Li C Ma and W Zhu ldquoComparisons of logisticregression and Fisher discriminant classifier to seismic eventidentificationrdquo Disaster Advances vol 6 p 8 2013

[37] P Samui ldquoMultivariate adaptive regression spline (Mars) forprediction of elasticmodulus of jointed rockmassrdquoGeotechnicaland Geological Engineering vol 31 pp 249ndash253 2013

[38] L Breiman ldquoRandom forestsrdquoMachine Learning vol 45 no 1pp 5ndash32 2001

[39] F Wang L Dong and Z Xu ldquoPhreatic line predicted method-based SVM for stability analysis of tailing damrdquo AppliedMechanics and Materials vol 44ndash47 pp 3398ndash3402 2011

[40] P Berchialla F Foltran and D Gregori ldquoNaıve Bayes classifierswith feature selection to predict hospitalization and complica-tions due to objects swallowing and ingestion among Europeanchildrenrdquo Safety Science vol 51 pp 1ndash5 2013

[41] Y-H Fu and L-J Dong ldquoBayes discriminant analysis modeland its application to the prediction and classification of rock-burstrdquo Journal of China University of Mining and Technologyvol 38 no 4 pp 528ndash533 2009

[42] P Domingos and M Pazzani ldquoOn the optimality of the simpleBayesian classifier under zero-one lossrdquoMachine Learning vol29 no 2-3 pp 103ndash130 1997

[43] A P Worth and M T D Cronin ldquoThe use of discriminantanalysis logistic regression and classification tree analysis in thedevelopment of classification models for human health effectsrdquoJournal of Molecular Structure THEOCHEM vol 622 no 1-2pp 97ndash111 2003

[44] Y Bai J Deng L Dong and X Li ldquoApplication of Fisher dis-criminant method in goaf collapse predictionrdquoMining Researchand Development vol 28 no 5 p 5 2008

[45] A P Bradley ldquoThe use of the area under the ROC curve in theevaluation of machine learning algorithmsrdquo Pattern Recogni-tion vol 30 no 7 pp 1145ndash1159 1997

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Page 10: Research Article Comprehensive Models for Evaluating ...Based on Statistical Comparisons of Multiple Classifiers LongjunDongandXibingLi School of Resourcesand Safety Engineering, CentralSouth

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of


Recommended