Image and Signal Processing Methods

Damage assessment framework for landslide disaster based on very high-resolution images

[+] Author Affiliations
Bo Sun, Jun He, Fengxiang Ge

Beijing Normal University, College of Information Science and Technology, Xinjiekouwai Street No. 19, Beijing 100875, China

Qihua Xu

Beijing Normal University, College of Information Science and Technology, Xinjiekouwai Street No. 19, Beijing 100875, China

Northwest Normal University, School of Business, No. 967 Anning East Road, Lanzhou 730070, China

Zhen Liu

Beijing Normal University, Center for Information and Network Technology, Xinjiekouwai Street No. 19, Beijing 100875, China

Ying Wang

Beijing Normal University, Key Laboratory of Environmental Change and Natural Disaster of Ministry of Education, Xinjiekouwai Street No. 19, Beijing 100875, China

J. Appl. Remote Sens. 10(2), 025027 (Jun 28, 2016). doi:10.1117/1.JRS.10.025027
History: Received January 27, 2016; Accepted June 7, 2016
Text Size: A A A

Open Access Open Access

Abstract.  It is well known that rapid building damage assessment is necessary for postdisaster emergency relief and recovery. Based on an analysis of very high-resolution remote-sensing images, we propose an automatic building damage assessment framework for rainfall- or earthquake-induced landslide disasters. The framework consists of two parts that implement landslide detection and the damage classification of buildings, respectively. In this framework, an approach based on modified object-based sparse representation classification and morphological processing is used for automatic landslide detection. Moreover, we propose a building damage classification model, which is a classification strategy designed for affected buildings based on the spectral characteristics of the landslide disaster and the morphological characteristics of building damage. The effectiveness of the proposed framework was verified by applying it to remote-sensing images from Wenchuan County, China, in 2008, in the aftermath of an earthquake. It can be useful for decision makers, disaster management agencies, and scientific research organizations.

Figures in this Article

A landslide is a geological occurrence that can cause severe loss of life, agricultural production, and the environment. Landslide disasters occur almost every year, and response time is a crucial factor in the effectiveness of postdisaster relief in such situations. In order to adequately provide emergency relief, decision makers and rescue organizations need a global perspective on the situation onsite.1 With the development of satellite and airborne remote-sensing technologies, the outputs of very high-resolution (VHR) optical images and synthetic aperture radar (SAR) images have shown a marked improvement in quality.2 These images have been widely used in a variety of fields that use remote sensing, one of which is image processing for postdisaster emergency response.

The main objective of this paper is to devise a method for convenient and efficient building damage assessment based on an analysis of images of these structures in areas affected by landslides. According to our survey of the literature, research on building damage assessment has focused on this task against the backdrop of earthquakes. Chesnel et al.3 proposed a semiautomatic damage assessment method based on a pair of very high-spatial resolution images and some ancillary data. Their system assessed damage to buildings using the change detection method. Klonus et al.4 proposed a modified change detection method based on isotropic frequency filtering, spectral and texture analysis, and segmentation, which yielded superior accuracy to standard methods. Although conventional change detection methods always work well in assessing building damage, their anti-interference ability is poor. Their results are easily influenced by natural factors, such as the solar incident angle, seasonal variation, and the Earth’s surface humidity. Li et al.5 detected building damage in urban environments from multitemporal VHR image data using the one-class support vector machine. This method performed better at the object level than at the pixel level, with an overall accuracy of 82.33%. Gerke and Kerle6 proposed a two-step approach for building damage classification. This method yielded an overall classification accuracy of 70% for four classes and a building damage identification accuracy of 63%. Although high-classification accuracy can be obtained, it is premised on the airborne, oblique pictometry imagery available.

In addition to research that has used high-resolution optical images, other studies have been conducted based on SAR images to consider the impact of climatic conditions and occlusion on the optical images.711 These methods have yielded satisfactory assessment results, but they cannot be generalized to other types of disasters, such as landslides. Thus, in this study, we design an automatic damage assessment framework for buildings in the aftermath of landslides according to the characteristics of the damage caused. The proposed framework first exploits object-based classification to detect landslides and combines the detection results and a building damage classification model (BDCM) to realize the entire assessment process. In particular, the main contributions of this paper are as follows:

  1. An automatic assessment framework for building damage caused by landslide disaster based on VHR images is proposed. It can efficiently assess the degree of building damage, which can be helpful for subsequent disaster relief work.
  2. An approach based on the modified object-based sparse representation classification (SRC) method and morphological processing is introduced for landslide detection.
  3. A quantitative building damage classification scheme for landslide disaster is introduced. Based on this, a BDCM is proposed. The effectiveness of the model is also verified.

The remainder of this paper is organized as follows: In Sec. 2, we review related literature. Section 3 consists of a description of the morphological quantitative scheme for building damage caused by landslides. In Sec. 4, the proposed assessment framework is described in detail. Experiments to test the proposed framework are detailed in Sec. 5, and our conclusions are given in Sec. 6.

Landslide detection is clearly required before damage to a building can be assessed. In recent years, research on landslide detection has developed quite rapidly. Methods based on varying sensor data have been exploited to discriminate landslide-affected regions from the background and analyze them. Since optical images may carry many spectral characteristics and details of the target, they are widely used. Research on landslide detection based on optical images can be divided into two types: pixel-based methods and object-oriented methods. In opposition to the former, which mainly consider spectral and textural features,12,13 the latter class of methods enables the consideration of more complex and advanced features.1417 To improve detection accuracy, some classical machine learning classification methods have been applied to remote-sensing image classification. These include support vector machines,18,19 artificial neural networks,20 and methods based on fuzzy theory.14,21 Studies show that these methods have achieved satisfactory classification effect based on VHR images.

Sometimes, weather in a disaster region is persistently foggy and cloudy following a hazardous occurrence. In this situation, SAR images are particularly useful due to their unique advantages of all-time and all-weather imaging.22 Li et al.23 found that landslide-affected areas show complicated scattering mechanisms because the landslide surface becomes relatively rough in the scale of the X-band. They distinguished landslide areas by using a supervised Wishart classifier and polarimetric scattering similarity parameters. This technique performs well in forested areas but is unsuitable for urban areas. Li et al.24 proposed another simple and effective approach for unsupervised classification of large-scale landslides. This involved first transforming PolSAR images from the RGB color space to the hue-saturation-intensity color space. A combination of k-means clustering and hue-saturation-intensity imagery in different channels was then used stage by stage for automatic landslide extraction. This method is suited for large-scale landslide detection. Inspired by this approach, our framework involves the transformation of optical images from RGB to hue-saturation-value (HSV) space and the exploitation of a modified SRC method to detect landslide regions.

Since most natural signals can be satisfactorily represented by a sparse vector corresponding to the linear combination of a few dictionary atoms, sparse representation has been shown to be an extremely powerful tool in remote-sensing data processing. Chen et al.25,26 proposed a simultaneous joint sparsity model for hyperspectral image (HSI) target detection and classification. This exploits the fact that in HSI, neighboring pixels have similar spectral characteristics. Furthermore, they introduced a kernel sparse representation method27,28 that maps low-dimensional features to high-dimensional features and improves classification accuracy. Fang et al.29 proposed a multiscale adaptive sparse representation model for spectral–spatial HSI classification. It effectively exploits spatial information at multiple scales via an adaptive sparse strategy. Song et al.30 developed a classification strategy that applies extended multiattribute profiles to an SRC framework. This approach combines the advantages of sparse representation and rich structural information to provide efficient classification results for different multi/hyperspectral datasets. Furthermore, other sparse representation models have been proposed to improve classification accuracy, such as manifold-based sparse representation,31 regularized sparse representation,32 nonlocal weighted joint sparse representation,33 and sparse representation-based binary hypothesis.34

These sparsity-based classification methods have some common shortcomings that are mostly embodied in two aspects. On the one hand, they are almost at pixel level. Since the size of remote-sensing images is often very large, classification processing incurs high-time complexity. On the other hand, pixels in HSI are represented by N-dimensional vectors, where N is the number of spectral bands. If the number of HSI bands is small (such as three or four), pixel-based information is scarce, which leads to low-classification accuracy. To overcome these problems, we35 had proposed an object-based landslide and mudflow detection method that combined multichannel sparse representation and eight neighbor judgment methods. Using this, a large-sized remote-sensing image was divided into a number of uniform patches and each was vectorized as a processing object. This method may solve the above-mentioned defects, but much larger thresholds are needed in practice.

After further research, we have modified the SRC method to detect landslides. The implementation process is described in Sec. 4.

By carefully observing the characteristics of landslide-affected buildings in VHR images, we found certain regularities in morphological changes in landslides that are different from those due to earthquakes. These regularities are as follows:

  1. The affected buildings and landslides tend to have certain spatial relationships. The buildings tend to be located within or near areas hit by landslides. The distance between buildings and the landslide area appears to be inversely proportional to the degree of damage. That is, the shorter the distance, the more severe the degree of damage. The most severe degree of damage occurs when an entire building is buried under the landslide; buildings that remain intact in such cases are usually far from the landslide.
  2. The affected buildings usually exhibit morphological changes. Some structures suffer obvious deformation due to the impact of mud. Some are surrounded or even invaded by a lot of rubble, and the texture of the roofs of certain buildings becomes very chaotic.
  3. The degree of damage to a building is somewhat related to the depth of mud pouring into it. When a building is located along the edge of a landslide, mud usually pours into it, whereby the building is damaged but the texture of its roof remains unchanged. This is a specific but common form of damage in landslides.

Under the direction of experts at the Academy of Disaster Reduction and Emergency Management, operated by the Ministry of Civil Affairs and the Ministry of Education, we propose a quantitative building damage classification scheme for landslides according to morphological characteristics (Table 1). In this scheme, we classify affected buildings into four grades.

Table Grahic Jump Location
Table 1Building damage classification scheme applied to landslides.

We select two features to classify building damage according to the characteristics of two-dimensional remote-sensing images. They are (1) the spatial relationships between a building and the landslide area and (2) the roof texture. In order to calculate the spatial relationships, outlines of the building and the landslide are required. The former can be obtained either from relevant government departments or by hand annotation and the latter can be obtained by using the SRC-based approach.

Our proposed assessment framework is aimed at automatically classifying building damage when landslides occur. It consists of two parts—the SRC-based approach, which is used to detect landslides, and the classification model, which classifies affected buildings. The specific implementation process is shown in Fig. 1.

Graphic Jump Location
Fig. 1
F1 :

Structure and operation flow of the framework.

Sparse Representation Classification-Based Approach for Landslide Detection

According to the classification scheme, landslide detection, while imperative, is time-consuming. We studied the spectral characteristics of landslides and proposed an SRC-based approach for automatic landslide detection. It is composed of three procedures: dictionary construction, target detection, and morphological processing.

Dictionary construction

An overcompleted dictionary is crucial and necessary for the SRC method. Before the occurrence of a landslide, we collect a large number of typical sample patches (k×k size) from VHR remote-sensing images. These sample patches consist of landslide and background (nonlandslide) samples, each as a processing object. Since the landslide is mostly manifested in its spectral characteristics than in other features, and since the HSV color space is close to human color perception, we convert every patch from RGB color space to HSV.

In the HSV color space, hue is used to distinguish colors, saturation is the percentage of white light added to a pure color, and value refers to perceived light intensity.36 It is known that the method of calculating HSV spatial components might affect both recognition performance and computational efficiency. From practical experience, we quantify the HSV space component in unequal intervals. The quantization scheme is shown as Display Formula

H={0H(345,360]&[0,15]1H(15,25]2H(25,45]3H(45,55]4H(55,80]5H(80,108]6H(108,140]7H(140,165]8H(165,190]9H(190,220]10H(220,255]11H(255,275]12H(275,290]13H(290,316]14H(316,330]15H(330,345]S={0S[0,0.15]1S(0.15,0.4]2S(0.4,0.75]3S(0.75,1]V={0V[0,0.15]1V(0.15,0.4]2V(0.4,0.75]3V(0.75,1].(1)
Here, based on a color model derived from substantial analysis, we divide hue into 16 parts. Saturation and value are divided into four parts each. Then an HSV histogram is generated using quantified hue (H), saturation (S), and value (V) as Display Formula
G=QsQvH+QvS+V,(2)
where QS is the quantified series of S and QV is the quantified series of V. Here, we set QS=QV=4. Then Display Formula
G=16H+4S+V.(3)
Finally, we concatenate the 16×4×4 histogram and obtain a 256-dimensional vector for each patch, which is exactly an atom of the dictionary. Thus, we obtain an overcomplete dictionary D, which is the union of two low-dimensional subdictionaries, i.e., the landslide subdictionary and the background subdictionary spanned by landslide training samples {dil}i=1,2,3Nl and background training samples {dib}i=1,2,3Nb, respectively.

Since the sample patches are randomly selected, the constructed dictionary is redundant, and atom vectors are highly correlated. To solve this problem, we perform a preprocessing step called whitening, the goal of which is to make the dictionary less redundant. Thus, we construct an overcomplete dictionary where (i) the atoms are less correlated with one another and (ii) all atoms have the same variance.

Target detection

With a test VHR image patch, a corresponding 256-dimensional HSV histogram vector y is calculated in the same manner as that of an atom in the dictionary. According to the sparse representation theory, y can be approximately represented by a sparse vector x corresponding to the linear combination of all atoms, the mathematical representation of which is rendered as Display Formula

y(d1lα1+d2lα2++dNllαNl)+(d1bβ1+d2bβ2++dNbbβNb)=[d1ld2ldNll]Dl[α1α2αNl]Tα+[d1bd2bdNbb]Db[β1β2βNb]Tβ=Dlα+Dbβ=[DlDb]D[αβ]Tx=Dx,(4)
where Dl and Db are the landslide and background subdictionaries consisting of Nl landslide atoms and Nb background atoms, respectively. α and β are sparse vectors, whose nonzero entries correspond to the weighting of the atoms in Dl and Db, respectively. The 256×N matrix D with N=Nl+Nb is the training dictionary consisting of both the landslide and background training samples, and the N-dimensional vector x is a concatenation of the two vectors α and β, which is also a sparse vector. If y is a background patch, ideally, it cannot be sparsely represented by the landslide training samples. Namely, α is a zero vector and β is a sparse vector, and vice versa. Therefore, test patch y can be sparsely represented by the combined landslide and background dictionaries, and the locations of nonzero entries in the sparse vector x contain critical information about the class of y. To better illustrate this model, an example is shown in Fig. 2. The landslide dictionary contains Nl=540 training samples and the background dictionary contains Nb=735 training samples. For a background patch, the sparse representation vector x is shown in Fig. 2(a). We see that vector α (red entries) corresponding to the landslide dictionary is a zero vector and vector β (blue entries) corresponding to the background dictionary is a sparse vector. A whitened background sample histogram feature (black solid) and its approximation Dbβ (red dashed) are shown in Fig. 2(b).

Graphic Jump Location
Fig. 2
F2 :

Sparse representation of a background patch. (a) The sparse representation vector x consisting of vectors α (red entries) and β (blue entries). (b) A whitened background sample histogram feature (black solid) and its approximation Dbβ (red dashed).

The sparse vector x satisfies the equation y=Dx, and the number of its nonzero entries should be as less as possible. So we get the loss function as Display Formula

x^=argminDxy2subject to  x0K0,(5)
where .2 and .0 denote the 2-norm and the 0-norm, respectively. The latter is defined as the number of nonzero entries in the vector (also called the sparsity level of the vector).26K0 is a preset upper bound on the sparsity level.37 In the absence of a priori information of the K0, the aforementioned problem is satisfactorily solved by the sparsity adaptive matching pursuit algorithm.38

The sparse vector x^ is recovered by decomposing y over the preconstructed dictionary D. Thus, we may find the few atoms in D best representing y. The recovery process implicitly leads to a competition between the two subspaces (Dl and Db). Once sparse vector x^ is obtained, the residuals of recovery are calculated with the following equations: Display Formula

rl(y)=yDlα^2,rb(y)=yDbβ^2,(6)
where α^ and β^ denote the recovered sparse coefficients corresponding to the landslide and background dictionaries, respectively. The class of y can be determined by comparing the residuals rl(y) with rb(y). The detector is defined as Display Formula
P(y)=rl(y)rl(y)+rb(y).(7)
Finally, we preset threshold τ, which is a very small positive number based on experience. When output P(y) is greater than τ, the test patch is labeled as class 0; otherwise, it is labeled as class 1 Display Formula
Class(y)={0if  P(y)>τ1otherwise.(8)
If the class of a test patch is labeled as 0, it is determined to be a background patch. Otherwise, the patch is considered to be a potential landslide patch.

Morphological processing

According to the characteristics, a landslide should be a complete or continuous region, where each potential landslide patch should be an interconnection. Then in order to deal with broken or fragmented regions, some morphological processing operations, including the open operation, the close operation, and connected-component labeling, are applied to potential landslide patches. Some isolated patches should be eliminated if they are smaller than a given threshold θ and certain smaller holes should be filled. According to the average size of buildings and expert experience, our goal is to identify the landslide patch, whose area is larger than 200  m2. Therefore, we set this threshold θ as Display Formula

θ=200R2,(9)
where R is the resolution of the VHR image. Finally, some complete landslide areas are segmented. Morphological processing may not only reduce the miss rate and the false alarm rate, but can also smooth the boundary of the landslide. In this way, we can get a more accurate outline of the landslide. A flowchart of landslide detection is shown in Fig. 3.

Graphic Jump Location
Fig. 3
F3 :

Flowchart for landslide detection.

Building Damage Classification Model

In remote-sensing images, the outlines of the building and the landslide area embody polygons. We adopt the dimensionally extended nine-intersection model (DE-9IM) to analyze the spatial relationships of the two polygons.39 The DE-9IM model is a mathematical approach that defines a pair-wise spatial relationship between geometries of different types and dimensions. This model expresses spatial relationships among all types of geometries as pair-wise intersections of their interior, boundary, and exterior by considering the dimensions of the resulting intersections. It can be expressed as Display Formula

DE9IM(a,b)=[dim(I(a)I(b))dim(I(a)B(b))dim(I(a)E(b))dim(B(a)I(b))dim(B(a)B(b))dim(B(a)E(b))dim(E(a)I(b))dim(E(a)B(b))dim(E(a)E(b))],(10)
where dim is the maximum number of dimensions of the intersection () of the interior (I), the boundary (B), and the exterior (E) of geometries a and b. dim(x) can yield values {1,0,1,2}, specifically 1 for empty sets (Ø), 0 for points, 1 for lines, and 2 for areas. If we map the values {0, 1, 2} to T (true) and 1 to F (false), the DE-9IM model can be expressed as a matrix using the Boolean domain {T, F}.

There are many kinds of spatial relationship between two polygons. In this paper, we only need four. The corresponding spatial predicates are disjoint, touches, overlaps, and covers, and the matrix of the each predicate is as in Fig. 4.

Graphic Jump Location
Fig. 4
F4 :

Spatial predicates and correspondences to the matrix expression.

Finally, based on the above input data and spatial relationship theories, we designed the BDCM on the basis of the previous work,40 which is shown in Fig. 5. In this model, we determine the building damage grade directly when the spatial relationship between the outlines of the building and the landslide areas are covered or overlapped. If the relationship is disjoint, the shortest Euclidean distance between two regions needs to be calculated. According to the experience of experts, 3 m is a suitable discrimination threshold. Therefore, we preset a shortest distance threshold Td to 3/R pixels (R is the resolution of the VHR image). When the shortest Euclidean distance is greater than Td, the degree of damage to the building is in the “intact” grade; otherwise, as in the “touch” relation, we need to calculate the texture of the roof of the building in the predisaster and the postdisaster images to classify the degree of damage as two grades according to textural differences. Since we find that texture is often not required, it is ignored in this paper.

Graphic Jump Location
Fig. 5
F5 :

The building damage classification model.

In order to test the performance of the proposed framework, VHR images for the Wenchuan earthquake in China on May 12, 2008, were acquired and analyzed. This earthquake triggered massive landslides and mud-rock flow that caused a large number of casualties and massive damage to infrastructure. We used the QuickBird pre-event image acquired on June 26, 2005, and the QuickBird postevent image acquired on June 3, 2008. Both images were acquired in panchromatic and multispectral modes with spatial resolutions of 0.61 and 2.4 m, respectively. Following image fusion, we obtained the 0.61-m multispectral images used in our experiments.

The experiments were executed on a personal computer running on an Intel Core2 Quad CPU at 2.83 GHz with 4 GB of memory. Figure 6 shows images of Wenchuan County before and after the earthquake. One subset containing images of damaged buildings was marked as the experimental region and is shown bounded by a red box in Fig. 6.

Graphic Jump Location
Fig. 6
F6 :

VHR images of Wenchuan County before (a) and after (b) the earthquake.

Landslide Detection Experiments

Prior to damage grading, we cropped 4500 sample patches (size=24×24) consisting of 2000 landslide sample patches and 2500 background sample patches from several landslide remote-sensing images. For comparison, we calculated the HSV histogram features and the RGB histogram features for each sample patch. Finally, we concatenated the different color space histogram features and obtained two R4500×256 dictionaries.

The SRC method based on both HSV and RGB histogram features was applied to the experimental images of Wenchuan County, and the results were compared both visually and quantitatively by using receiver operating characteristics (ROC) curves. In our study, the identification of landslide patches and nonlandslide (background) patches is a binary classification problem, where outcomes are labeled either as positive (p) or negative (n). The ROC curve illustrates the performance of the binary classifier system as its discrimination threshold is varied. It is defined by a true positive rate (TPR) and a false positive rate (FPR), which are labeled as x- and y-axes, respectively. In our experiments, the class labels for all test patches were determined at each threshold. The TPR is the ratio of the number of hits (landslide patches determined as landslides) to the total number of true landslide patches, and the FPR was calculated by the number of false alarms (background patches determined as landslide) over the total number of background patches.

The pre- and postevent images of Wenchuan County used for the experiment are shown in Figs. 7(a) and 7(b), respectively. In order to evaluate our landslide detection method, the SRC experiments based on the above two dictionaries were performed and their experimental results were compared with the visual interpretation results. The visual interpretation results of the landslide areas from the National Disaster Reduction Center of China are shown in Fig. 7(c). Figure 7(d) shows the visual interpretation of landslide areas overlying the postevent image. The RGB histogram-based classification results are shown in Figs. 7(e) and 7(f), whereas Fig. 7(e) shows the binary classification results and Fig. 7(f) shows the final landslide detection areas overlying the postevent image. Similarly, the results of the HSV histogram-based classification are shown in Figs. 7(g) and 7(h). Both experiments employed morphological processing. To eliminate isolated potential landslide patches, the area threshold was set 540 pixels automatically, equivalent to 200  m2. The corresponding ROC curves are shown in Fig. 8, which shows that the SRC method using the HSV histogram feature dictionary was more effective.

Graphic Jump Location
Fig. 7
F7 :

Landslide detection result with two different feature dictionaries: (a) the pre-event VHR image of major disaster areas in Wenchuan County, (b) the postevent VHR image of major disaster areas in Wenchuan County, (c) visual interpretation results of landslide areas, (d) visual interpretation landslide areas overlaid on (b), (e) landslide detection result according to RGB histogram feature dictionary, (f) RGB histogram-based classified landslide areas overlaid on (b), (g) landslide detection result according to HSV histogram feature dictionary, and (h) HSV histogram-based classification landslide areas overlaid on (b).

Graphic Jump Location
Fig. 8
F8 :

ROC curves of landslide detection results using two dictionaries.

Experiments on Building Damage Classification Model

After obtaining landslide detection results through the SRC-based framework, we easily obtained the outlines of the landslide area. The outlines were entered into the BDCM. Meanwhile, the outline of the building obtained from the cooperation in advance was also entered into this model. In this experiment, the shortest distance threshold Td was set as 5 pixels, approximately equal to 3 m (5×0.61  m). Finally, the model assigned a damage grade to each affected building (Fig. 9). The assessment results were then displayed, and all kinds of assessment reports could be generated depending on the user’s requirements.

Graphic Jump Location
Fig. 9
F9 :

The building damage assessment results of part of the postevent VHR image: (a) the outline of affected buildings and (b) classification results of building damage.

In this case, the total number of buildings was 106, and the number of correct classifications was 92. The assessment results are depicted by a confuse matrix shown in Table 2. Here, the rows represent assessment results obtained using our method, and the columns show the reference data from the National Disaster Reduction Center of China. The results were satisfactory, with high producer accuracy and user accuracy. The overall accuracy was 86.79%, and the Kappa coefficient was 0.82.

Table Grahic Jump Location
Table 2The confuse matrix display of assessment results.

In this paper, we developed an effective and reliable assessment framework to classify building damage caused by landslides. The framework can yield satisfactory results by taking advantage of VHR optical remote-sensing images. This framework not only exploits the advantages of remote-sensing data, but also reduces the participation of experts. Experiments showed that the framework can provide effective support for emergency disposal work and disaster management. Since the framework has been developed for VHR images, its performance will be affected by low-resolution images. Further modification and extended research will continue on this front.

This research was primarily supported by the National Natural Science Foundation of China (Grant No. 61501035), the Fundamental Research Funds for the Central Universities of China (No. 2014KJJCA15), the National Key Technology R&D Program of the 12th Five Year Plan of China (No. 2012BAK10B03), and the High-Resolution Special Scientific Research Project from the National Disaster Reduction Center of China, Ministry of Civil Affairs (No. 03-Y30B06-9001-13/15).

Dubois  D., and Lepage  R., “Fast and efficient evaluation of building damage from very high resolution optical satellite images,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 7, (10 ), 4167 –4176 (2014).CrossRef
Benediktsson  J. A., , Chanussot  J., and Moon  W. M., “Very high-resolution remote sensing: challenges and opportunities” Proc. IEEE. 100, (6 ), 1907 –1910 (2012). 0018-9219 CrossRef
Chesnel  A. L., , Binet  R., and Wald  L., “Damage assessment on buildings using multisensor multimodal very high resolution images and ancillary data,” in  IEEE Int. Geoscience & Remote Sensing Symp. (IGARSS ‘08) , pp. 1252 –1255,  Boston  (2008).CrossRef
Klonus  S.  et al., “Combined edge segment texture analysis for the detection of damaged buildings in crisis areas,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 5, (4 ), 1118 –1128 (2012).CrossRef
Li  P., , Xu  H., and Guo  J., “Urban building damage detection from very high resolution imagery using OCSVM and spatial features,” Int. J. Remote Sens.. 31, (13 ), 3393 –3409 (2010). 0143-1161 CrossRef
Gerke  M., and Kerle  N., “Automatic structural seismic damage assessment with airborne oblique Pictometry© imagery,” Photogramm. Eng. Remote Sens.. 77, (1 ), 885 –898 (2011).CrossRef
Shinozuka  M., and Ghanem  R., “Damage detection in urban areas by SAR imagery,” J. Eng. Mech.. 126, (7 ), 769 –777 (2000). 0733-9399 CrossRef
Matsuoka  M., and Nojima  N., “Building damage estimation by integration of seismic intensity information and satellite L-band SAR imagery,” Remote Sens.. 2, (1 ), 2111 –2126 (2010).CrossRef
Lau  S. W., “Comparison and fusion of space borne L- C- and X-band SAR images for damage identification in the 2008 Sichuan earthquake,” TRITA-GIT EX 11-003,  Royal Institute of Technology (KTH) ,  Stockholm, Sweden  (2011).
Miura  H., , Midorikawa  S., and Matsuoka  M., “Building damage assessment using high-resolution satellite SAR images of the 2010 Haiti earthquake,” Earthquake Spectra. 32, (1 ), 591 –610 (2016).CrossRef
Zhai  W.  et al., “Building earthquake damage information extraction from a single post-earthquake PolSAR image,” Remote Sens.. 8, (1 ), 171  (2016).CrossRef
Chakraborty  D., and Maulik  U., “Semisupervised pixel classification of remote sensing imagery using transductive SVM,” in  Recent Trends in Information Systems (ReTIS ‘11) , pp. 30 –35 (2011).CrossRef
Mondini  A. C.  et al., “Semi-automatic recognition and mapping of rainfall induced shallow landslides using optical satellite images,” Remote Sens. Environ.. 115, (7 ), 1743 –1757 (2011). 0034-4257 CrossRef
Aksoy  B., and Ercanoglu  M., “Landslide identification and classification by object-based image analysis and fuzzy logic: an example from the Azdavay region,” Comput. Geosci.. 38, (1 ), 87 –98 (2012).CrossRef
Jiann-Yeou  R., , Jyun-Ping  J., and Ruey-Juin  R., “Semiautomatic object-oriented landslide recognition scheme from multisensor optical imagery and DEM,” IEEE Trans. Geosci. Remote Sens.. 52, (2 ), 1336 –1349 (2014). 0196-2892 CrossRef
Martha  T. R.  et al., “Characterising spectral, spatial and morphometric properties of landslides for semi-automatic detection using object-oriented methods,” Geomorphology. 116, (1 ), 24 –36 (2010).CrossRef
Martha  T. R.  et al., “Segment optimization and data-driven thresholding for knowledge-based landslide detection by object-based image analysis,” IEEE Trans. Geosci. Remote Sens.. 49, (12 ), 4928 –4943 (2011). 0196-2892 CrossRef
Hu  Y., “Remote sensing image classification based on SVM classifier,” in  System Science, Engineering Design and Manufacturing Informatization (ICSEM ‘11) , pp. 30 –33,  Honolulu, Hawaii  (2011).CrossRef
Wei  Z.-Z., , Wei  X., and Wei  X.-G., “Landslide recognition in mountain image based on support vector machine,” in Measuring Technology and Mechatronics Automation in Electrical Engineering. , pp. 279 –286,  Springer ,  New York  (2012).
Yie-Ruey  C.  et al., “The application of remote sensing technology to the interpretation of land use for rainfall-induced landslides based on genetic algorithms and artificial neural networks,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 2, (2 ), 87 –95 (2009).CrossRef
Wen  C., and Minhe  J., “Comparative analysis of fuzzy approaches to remote sensing image classification,” in  Fuzzy Systems and Knowledge Discovery (FSKD ‘10) , pp. 537 –541 (2010).CrossRef
Zhai  W.  et al., “Fusion of polarimetric and texture information for urban building extraction from fully polarimetric SAR imagery,” Remote Sens. Lett.. 7, (1 ), 31 –40 (2016).CrossRef
Li  N.  et al., “Polarimetric response of landslides at X-band following the Wenchuan earthquake,” IEEE Geosci. Remote Sens. Lett.. 11, (10 ), 1722 –1726 (2014).CrossRef
Li  N.  et al., “Unsupervised polarimetric synthetic aperture radar classification of large-scale landslides caused by Wenchuan earthquake in hue-saturation-intensity color space,” J. Appl. Remote Sens.. 8, (1 ), 083595  (2014).CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Hyperspectral image classification using dictionary-based sparse representation,” IEEE Trans. Geosci. Remote Sens.. 49, (10 ), 3973 –3985 (2011). 0196-2892 CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Sparse representation for target detection in hyperspectral imagery,” IEEE J. Sel. Top. Signal Process.. 5, (3 ), 629 –640 (2011).CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Kernel sparse representation for hyperspectral target detection,” Proc. SPIE. 8390, , 839005  (2012). 0277-786X CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Hyperspectral image classification via kernel sparse representation,” IEEE Trans. Geosci. Remote Sens.. 51, (1 ), 217 –231 (2013). 0196-2892 CrossRef
Fang  L.  et al., “Spectral–spatial hyperspectral image classification via multiscale adaptive sparse representation,” IEEE Trans. Geosci. Remote Sens.. 52, (12 ), 7738 –7749 (2014). 0196-2892 CrossRef
Song  B.  et al., “Remotely sensed image classification using sparse representations of morphological attribute profiles,” IEEE Trans. Geosci. Remote Sens.. 52, (8 ), 5122 –5136 (2014). 0196-2892 CrossRef
Tang  Y. Y., , Yuan  H., and Li  L., “Manifold-based sparse representation for hyperspectral image classification,” IEEE Trans. Geosci. Remote Sens.. 52, (12 ), 7606 –7618 (2014). 0196-2892 CrossRef
Yuan  H.  et al., “Hyperspectral image classification based on regularized sparse representation,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 7, (6 ), 2174 –2182 (2014).CrossRef
Zhang  H.  et al., “A nonlocal weighted joint sparse representation classification method for hyperspectral imagery,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 7, (6 ), 2056 –2065 (2014).CrossRef
Zhang  Y., , Du  B., and Zhang  L., “A sparse representation-based binary hypothesis model for target detection in hyperspectral images,” IEEE Trans. Geosci. Remote Sens.. 53, (3 ), 1346 –1354 (2015). 0196-2892 CrossRef
Chao  C.  et al., “Automatic landslide and mudflow detection method via multichannel sparse representation,” Proc. SPIE. 9644, , 96441J  (2015). 0277-786X CrossRef
John  D., , Tharani  S. T., and SreeKumar  K., “Content based image retrieval using HSV-color histogram and GLCM,” Int. J. Adv. Res. Comput. Sci. Manage. Stud.. 2, (1 ), 246 –253 (2014).
Tropp  J. A., and Wright  S. J., “Computational methods for sparse solution of linear inverse problems,” Proc. IEEE. 98, (6 ), 948 –958 (2010). 0018-9219 CrossRef
Do  T.T.  et al., “Sparsity adaptive matching pursuit algorithm for practical compressed sensing,” in  2008 42nd Asilomar Conf. on Signals, Systems and Computers , pp. 581 –587 (2008).CrossRef
Clementini  E., , Sharma  J., and Egenhofer  M. J., “Modelling topological spatial relations: strategies for query processing,” Comput. Graphics. 18, (6 ), 815 –822 (1994).CrossRef
Sun  B.  et al., “Semi-auto assessment system on building damage caused by landslide disaster with high-resolution satellite and aerial images,” Proc. SPIE. 9643, , 96431O  (2015). 0277-786X CrossRef

Bo Sun received his BSc degree in computer science from Beihang University, China, and his MSc and PhD degrees from Beijing Normal University, Beijing, China. He is currently a professor at the Department of Computer Science and Technology, Beijing Normal University. His research interests include pattern recognition, natural language processing, and information systems. He is a member of the Association for Computing Machinery and a senior member of the China Society of Image and Graphics.

Qihua Xu received his BSc degree from Southwest Normal University and his MSc degree in computer application technology from Renmin University of China. Since 2009, he has been with the School of Business, Northwest Normal University, Lanzhou, China. He is currently a PhD candidate majoring in computer application technology at Beijing Normal University. His research interests include machine learning and pattern recognition.

Jun He received her BSc degree in optical engineering and her PhD in physical electronics from Beijing Institute of Technology, Beijing, China, in 1998 and 2003, respectively. Since 2003, she has been with the College of Information Science and Technology, Beijing Normal University, Beijing, China. She was elected as a lecturer and an assistant professor in 2003 and 2010, respectively. She is currently teaching and engaged in research. Her research interests include image processing applications and pattern recognition.

Zhen Liu received his MSc degree in cartology and remote sensing and his PhD degree in remote sensing and geographic information systems from Beijing Normal University, Beijing, China, in 1998 and 2004 respectively. He was a postdoctoral scholar with UC Irvine. He is currently a full professor and the director of the Center of Information and Network Technology in Beijing Normal University. His research interests include feature extraction and change detection using remote-sensing images, spatio-temporal modeling and applications.

Ying Wang is an experienced researcher at Beijing Normal University, a consultant with China’s National Disaster Reduction Centre, Department of Disaster Relief and Ministry of Civil Affairs, China’s Ministry of Science and Technology. He has researched earthquake-induced hazard chains, comprehensive risk assessments, reconstruction, rural livelihoods, assessing rural housing vulnerabilities, emergency responses, postdisaster resettlement, recovery modeling, agricultural insurance, evacuation training, and brought scientific knowledge into communities to mitigate risk and maximize resilience in Yunnan and Sichuan.

Fengxiang Ge received his BSc and MSc degrees from Harbin Engineering University in 1996 and 1999, respectively, and his PhD degree from Tsinghua University in 2003. From 2003 to 2005, he was a research associate in the University of Hong Kong. In 2005, he joined Intel Corporation as a senior researcher and architect. In 2011, he joined Beijing Normal University as an associate professor. His research interests include signal processing and its applications.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation

Bo Sun ; Qihua Xu ; Jun He ; Zhen Liu ; Ying Wang, et al.
"Damage assessment framework for landslide disaster based on very high-resolution images", J. Appl. Remote Sens. 10(2), 025027 (Jun 28, 2016). ; http://dx.doi.org/10.1117/1.JRS.10.025027


Figures

Graphic Jump Location
Fig. 1
F1 :

Structure and operation flow of the framework.

Graphic Jump Location
Fig. 3
F3 :

Flowchart for landslide detection.

Graphic Jump Location
Fig. 4
F4 :

Spatial predicates and correspondences to the matrix expression.

Graphic Jump Location
Fig. 5
F5 :

The building damage classification model.

Graphic Jump Location
Fig. 6
F6 :

VHR images of Wenchuan County before (a) and after (b) the earthquake.

Graphic Jump Location
Fig. 7
F7 :

Landslide detection result with two different feature dictionaries: (a) the pre-event VHR image of major disaster areas in Wenchuan County, (b) the postevent VHR image of major disaster areas in Wenchuan County, (c) visual interpretation results of landslide areas, (d) visual interpretation landslide areas overlaid on (b), (e) landslide detection result according to RGB histogram feature dictionary, (f) RGB histogram-based classified landslide areas overlaid on (b), (g) landslide detection result according to HSV histogram feature dictionary, and (h) HSV histogram-based classification landslide areas overlaid on (b).

Graphic Jump Location
Fig. 8
F8 :

ROC curves of landslide detection results using two dictionaries.

Graphic Jump Location
Fig. 9
F9 :

The building damage assessment results of part of the postevent VHR image: (a) the outline of affected buildings and (b) classification results of building damage.

Graphic Jump Location
Fig. 2
F2 :

Sparse representation of a background patch. (a) The sparse representation vector x consisting of vectors α (red entries) and β (blue entries). (b) A whitened background sample histogram feature (black solid) and its approximation Dbβ (red dashed).

Tables

Table Grahic Jump Location
Table 1Building damage classification scheme applied to landslides.
Table Grahic Jump Location
Table 2The confuse matrix display of assessment results.

References

Dubois  D., and Lepage  R., “Fast and efficient evaluation of building damage from very high resolution optical satellite images,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 7, (10 ), 4167 –4176 (2014).CrossRef
Benediktsson  J. A., , Chanussot  J., and Moon  W. M., “Very high-resolution remote sensing: challenges and opportunities” Proc. IEEE. 100, (6 ), 1907 –1910 (2012). 0018-9219 CrossRef
Chesnel  A. L., , Binet  R., and Wald  L., “Damage assessment on buildings using multisensor multimodal very high resolution images and ancillary data,” in  IEEE Int. Geoscience & Remote Sensing Symp. (IGARSS ‘08) , pp. 1252 –1255,  Boston  (2008).CrossRef
Klonus  S.  et al., “Combined edge segment texture analysis for the detection of damaged buildings in crisis areas,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 5, (4 ), 1118 –1128 (2012).CrossRef
Li  P., , Xu  H., and Guo  J., “Urban building damage detection from very high resolution imagery using OCSVM and spatial features,” Int. J. Remote Sens.. 31, (13 ), 3393 –3409 (2010). 0143-1161 CrossRef
Gerke  M., and Kerle  N., “Automatic structural seismic damage assessment with airborne oblique Pictometry© imagery,” Photogramm. Eng. Remote Sens.. 77, (1 ), 885 –898 (2011).CrossRef
Shinozuka  M., and Ghanem  R., “Damage detection in urban areas by SAR imagery,” J. Eng. Mech.. 126, (7 ), 769 –777 (2000). 0733-9399 CrossRef
Matsuoka  M., and Nojima  N., “Building damage estimation by integration of seismic intensity information and satellite L-band SAR imagery,” Remote Sens.. 2, (1 ), 2111 –2126 (2010).CrossRef
Lau  S. W., “Comparison and fusion of space borne L- C- and X-band SAR images for damage identification in the 2008 Sichuan earthquake,” TRITA-GIT EX 11-003,  Royal Institute of Technology (KTH) ,  Stockholm, Sweden  (2011).
Miura  H., , Midorikawa  S., and Matsuoka  M., “Building damage assessment using high-resolution satellite SAR images of the 2010 Haiti earthquake,” Earthquake Spectra. 32, (1 ), 591 –610 (2016).CrossRef
Zhai  W.  et al., “Building earthquake damage information extraction from a single post-earthquake PolSAR image,” Remote Sens.. 8, (1 ), 171  (2016).CrossRef
Chakraborty  D., and Maulik  U., “Semisupervised pixel classification of remote sensing imagery using transductive SVM,” in  Recent Trends in Information Systems (ReTIS ‘11) , pp. 30 –35 (2011).CrossRef
Mondini  A. C.  et al., “Semi-automatic recognition and mapping of rainfall induced shallow landslides using optical satellite images,” Remote Sens. Environ.. 115, (7 ), 1743 –1757 (2011). 0034-4257 CrossRef
Aksoy  B., and Ercanoglu  M., “Landslide identification and classification by object-based image analysis and fuzzy logic: an example from the Azdavay region,” Comput. Geosci.. 38, (1 ), 87 –98 (2012).CrossRef
Jiann-Yeou  R., , Jyun-Ping  J., and Ruey-Juin  R., “Semiautomatic object-oriented landslide recognition scheme from multisensor optical imagery and DEM,” IEEE Trans. Geosci. Remote Sens.. 52, (2 ), 1336 –1349 (2014). 0196-2892 CrossRef
Martha  T. R.  et al., “Characterising spectral, spatial and morphometric properties of landslides for semi-automatic detection using object-oriented methods,” Geomorphology. 116, (1 ), 24 –36 (2010).CrossRef
Martha  T. R.  et al., “Segment optimization and data-driven thresholding for knowledge-based landslide detection by object-based image analysis,” IEEE Trans. Geosci. Remote Sens.. 49, (12 ), 4928 –4943 (2011). 0196-2892 CrossRef
Hu  Y., “Remote sensing image classification based on SVM classifier,” in  System Science, Engineering Design and Manufacturing Informatization (ICSEM ‘11) , pp. 30 –33,  Honolulu, Hawaii  (2011).CrossRef
Wei  Z.-Z., , Wei  X., and Wei  X.-G., “Landslide recognition in mountain image based on support vector machine,” in Measuring Technology and Mechatronics Automation in Electrical Engineering. , pp. 279 –286,  Springer ,  New York  (2012).
Yie-Ruey  C.  et al., “The application of remote sensing technology to the interpretation of land use for rainfall-induced landslides based on genetic algorithms and artificial neural networks,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 2, (2 ), 87 –95 (2009).CrossRef
Wen  C., and Minhe  J., “Comparative analysis of fuzzy approaches to remote sensing image classification,” in  Fuzzy Systems and Knowledge Discovery (FSKD ‘10) , pp. 537 –541 (2010).CrossRef
Zhai  W.  et al., “Fusion of polarimetric and texture information for urban building extraction from fully polarimetric SAR imagery,” Remote Sens. Lett.. 7, (1 ), 31 –40 (2016).CrossRef
Li  N.  et al., “Polarimetric response of landslides at X-band following the Wenchuan earthquake,” IEEE Geosci. Remote Sens. Lett.. 11, (10 ), 1722 –1726 (2014).CrossRef
Li  N.  et al., “Unsupervised polarimetric synthetic aperture radar classification of large-scale landslides caused by Wenchuan earthquake in hue-saturation-intensity color space,” J. Appl. Remote Sens.. 8, (1 ), 083595  (2014).CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Hyperspectral image classification using dictionary-based sparse representation,” IEEE Trans. Geosci. Remote Sens.. 49, (10 ), 3973 –3985 (2011). 0196-2892 CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Sparse representation for target detection in hyperspectral imagery,” IEEE J. Sel. Top. Signal Process.. 5, (3 ), 629 –640 (2011).CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Kernel sparse representation for hyperspectral target detection,” Proc. SPIE. 8390, , 839005  (2012). 0277-786X CrossRef
Chen  Y., , Nasrabadi  N. M., and Tran  T. D., “Hyperspectral image classification via kernel sparse representation,” IEEE Trans. Geosci. Remote Sens.. 51, (1 ), 217 –231 (2013). 0196-2892 CrossRef
Fang  L.  et al., “Spectral–spatial hyperspectral image classification via multiscale adaptive sparse representation,” IEEE Trans. Geosci. Remote Sens.. 52, (12 ), 7738 –7749 (2014). 0196-2892 CrossRef
Song  B.  et al., “Remotely sensed image classification using sparse representations of morphological attribute profiles,” IEEE Trans. Geosci. Remote Sens.. 52, (8 ), 5122 –5136 (2014). 0196-2892 CrossRef
Tang  Y. Y., , Yuan  H., and Li  L., “Manifold-based sparse representation for hyperspectral image classification,” IEEE Trans. Geosci. Remote Sens.. 52, (12 ), 7606 –7618 (2014). 0196-2892 CrossRef
Yuan  H.  et al., “Hyperspectral image classification based on regularized sparse representation,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 7, (6 ), 2174 –2182 (2014).CrossRef
Zhang  H.  et al., “A nonlocal weighted joint sparse representation classification method for hyperspectral imagery,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.. 7, (6 ), 2056 –2065 (2014).CrossRef
Zhang  Y., , Du  B., and Zhang  L., “A sparse representation-based binary hypothesis model for target detection in hyperspectral images,” IEEE Trans. Geosci. Remote Sens.. 53, (3 ), 1346 –1354 (2015). 0196-2892 CrossRef
Chao  C.  et al., “Automatic landslide and mudflow detection method via multichannel sparse representation,” Proc. SPIE. 9644, , 96441J  (2015). 0277-786X CrossRef
John  D., , Tharani  S. T., and SreeKumar  K., “Content based image retrieval using HSV-color histogram and GLCM,” Int. J. Adv. Res. Comput. Sci. Manage. Stud.. 2, (1 ), 246 –253 (2014).
Tropp  J. A., and Wright  S. J., “Computational methods for sparse solution of linear inverse problems,” Proc. IEEE. 98, (6 ), 948 –958 (2010). 0018-9219 CrossRef
Do  T.T.  et al., “Sparsity adaptive matching pursuit algorithm for practical compressed sensing,” in  2008 42nd Asilomar Conf. on Signals, Systems and Computers , pp. 581 –587 (2008).CrossRef
Clementini  E., , Sharma  J., and Egenhofer  M. J., “Modelling topological spatial relations: strategies for query processing,” Comput. Graphics. 18, (6 ), 815 –822 (1994).CrossRef
Sun  B.  et al., “Semi-auto assessment system on building damage caused by landslide disaster with high-resolution satellite and aerial images,” Proc. SPIE. 9643, , 96431O  (2015). 0277-786X CrossRef

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Topic Collections

PubMed Articles
Advertisement


 

  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.