SSSAJ Journal of Natural Resources and Life Sciences Education
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Published online 19 April 2006
Published in Soil Sci Soc Am J 70:920-929 (2006)
DOI: 10.2136/sssaj2004.0141
© 2006 Soil Science Society of America
677 S. Segoe Rd., Madison, WI 53711 USA
This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hengl, T.
Right arrow Articles by Husnjak, S.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Hengl, T.
Right arrow Articles by Husnjak, S.
Agricola
Right arrow Articles by Hengl, T.
Right arrow Articles by Husnjak, S.
Related Collections
Right arrow Soil Methods/Instrumentation

Pedology

Evaluating Adequacy and Usability of Soil Maps in Croatia

Tomislav Hengla,* and Stjepan Husnjakb

a European Commission, Directorate General JRC, Land Management and Natural Hazards Unit, Ispra (VA), Italy
b Soil Science Dep., Faculty of Agriculture, Univ. of Zagreb, Svetosimunska 25, 10000 Zagreb, Croatia

* Corresponding author (tomislav.hengl{at}jrc.it)


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 CONCLUSIONS
 REFERENCES
 
The paper suggests a methodological framework for evaluating adequacy and usability of soil maps by analyzing the following 10 aspects: lineage, consistency, completeness, effective scale, attribute accuracy, thematic contrast, accuracy of legends, integrity, popularity, and accessibility. This framework was used to evaluate the national soil resource inventory in Croatia and to find out why the maps are not used to the full potential. Six 1:50K map sheets (of 185 in total), 3 control surveys, and 10 full profile descriptions in the main landscape regions of Croatia were used to estimate the effective map scale and thematic accuracy of profile observations. In addition, the existing digital data sets (digital soil map and database with 2198 profiles) were evaluated for thematic purity and contrast. The results show that the soil maps are of lower quality than planned and that their usability for spatial planning is limited. The average polygon size and the positional accuracy of primary soil boundaries correspond to the 1:150K scale, while the intensity of field observations corresponds to the 1:250K scale. Mapping units are heterogeneous for mapping of clay content, pH, and organic matter, with an average normalized variation of 68% within units and the mean thematic overlap of 66% between geographically adjacent units. This makes this inventory adequate for small-scale applications only. The major usability problems identified were lack of specific interpretations corresponding to user needs, unpopularity of soil survey concepts, inconsistency of methodology and unclear distribution policy. The evaluation can be used to decide how to improve the usability of the existing datasets and design methodological steps for a new survey by involving end users in the design of the soil information system.

Abbreviations: AD, area of disagreement • ASD, average size delineation • BSMC, Basic Soil Map of Croatia • CYS, Classification of Yugoslav Soils • ESN, effective scale number • GIS, Geographic Information System • ILWIS, Integrated Land and Water Information System • IMR, index of maximum reduction • ISRIC, International Soil and Reference Information Centre • ME, mean absolute error • MLD, minimum legible delineation • RMSE, root mean square error • SIS, Soil Information System • SMU, soil mapping units


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 CONCLUSIONS
 REFERENCES
 
SEVERAL STUDIES in the past 30 yr have shown that the technical quality and usability of soil maps, especially the ones produced through national soil surveys, has often been overestimated or neglected. Marsman and de Gruijter (1986) showed that the actual purity of soil mapping units in the Netherlands is usually considerably lower than the anticipated level of 70%. Groot (1993) estimated that 80% of soil information in the world is unusable due to incompleteness, unknown reliability, or inconsistant spatial referencing. A major problem of assessing the quality of soil maps is that, typically, the same teams that make the original surveys are responsible for adequacy evaluation. In the USA, quality control and quality assurance are increasingly being arranged by an external and unbiased team (USDA–NRCS, 2003; Part 609), which is not the case of most other countries in the world. A general impression is that the quality issue of soil maps has been underrepresented in the literature and definitively deserves more exposure (Bishop et al., 2001).

Five main elements determine the overall quality of a map: lineage, positional and attribute accuracy, logical consistency, and completeness. These correspond to the quality measures and standards approved by the International Cartography Association and applicable to any GIS (Guptill and Morrison, 1995). Soil surveyors have developed a concept of adequacy of a soil resource inventory, which was first introduced by a group at Cornell University (Forbes et al., 1982). This group proposed that adequacy should be evaluated using four aspects: (1) map scale and texture, (2) map legend, (3) base map quality, and (4) ground truth, also called thematic accuracy. The last aspect has attracted attention of Dutch mappers (de Gruijter and Marsman, 1985; Marsman and de Gruijter, 1986).

Recently, the concept of spatial data usability, of which data quality is considered to be just one element, has been introduced (Wachowicz et al., 2002; Hunter et al., 2003). There are four general aspects of usability: (i) data quality (accuracy, completeness, logical consistency); (ii) data form(at); (iii) data accessibility and price, and (iv) quality of the metadata. The importance of each of these aspects may differ from user to user. For example, for environmental modelers, the incompatibility, low thematic contrast and detail of multi-source environmental geo-data will militate against their full usage. The difference between quality, adequacy, and usability is that quality is a set of constant technical characteristics, adequacy changes within the problem-solving context, while usability reflects all these elements in relation to the end-user satisfaction. Adequacy is related to the concept of effective scale—a less detailed soil map will show higher adequacy if used at smaller scales. Although usability is in practice hard to measure, Hunter et al. (2003) suggested some very concrete aspects of usability, such as data integrity, popularity, satisfaction, speed of access, reliability etc., which can be either measured directly or assessed through interviews. Soil mappers will increasingly need to find a balance between the availability of funds, models, tools, and users' demands. In fact, the key challenge to future soil mapping projects will be to fully identify and meet customers' needs (Indorante et al., 1996) and provide a better linkage with other earth and environmental sciences (Wysocki et al., 2005).

The objective of this research was to refine the methodology of evaluating the adequacy and usability of (traditional) polygon-based soil maps and then test it using a real case study. We decided to combine three methodological frameworks: (1) methodology to asses the adequacy of soil maps as described by Forbes et al. (1982) and Rossiter (2000); (2) methodology to assess the spatial data quality as described by Guptill and Morrison (1995); and (3) methodology to evaluate the usability of spatial databases as described by Hunter et al. (2003), which goes beyond pure technical measures. This framework was applied to a real case study: the national soil resource inventory in Croatia. This was a purely pedologic map, created by subjectively drawing boundaries on aerial photos and topo maps. Finally, we suggested a universal checklist of measurable aspects that can be used to determine the true adequacy and usability of soil maps.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 CONCLUSIONS
 REFERENCES
 
Case Study: the National Soil Resource Inventory in Croatia
During the late 1950s, soil scientists of the former Federal Republic of Yugoslavia agreed that an extensive general purpose inventory of soilscapes was needed to enhance spatial planning and nature conservation projects (Husnjak et al., 2006). Shortly after, each part of the federation formed their own mapping teams and slowly started to conduct surveys. In Croatia, mapping began in 1964 and lasted for 23 yr, finally ending in 1986. This project, also called "Basic Soil Map of Croatia" (BSMC), followed the soil survey methodology described by Kovacevic and Jaksic (1964) and the classification system developed by Kovacevic et al. (1967), and further modified by Skoric et al. (1985). The project was conducted as a series of more or less independent subprojects, one for each 15' by 15' topographic map sheet covering approximately 20 km by 27.5 km (Fig. 1a ). As a result, each adjacent map sheet did not necessarily have to fit the neighboring sheets.


Figure 1
View larger version (57K):
[in this window]
[in a new window]
 
Fig. 1. Soil mapping in Croatia: (a) 1:50K map sheets (left) and an example of a digitized map sheet with soil profiles, and (b) part of the soil map with legend.

 
Final products of the BSMC project were 186 (A2 paper format) soil map sheets, 165 manuscript reports, and about 10800 profile descriptions with standard laboratory data. Since project implementation was heavily delayed, both the survey teams and mapping methods were changed more than once. Mapping and legend concepts were quite different in the two periods of designing BSMC. In the first (lasting until 1972), mapping was performed directly on military topographic maps, without airphoto interpretation, and observations were exclusively profiles (without supplementary augerings), with an inspection density of two full pits and two to three semi-pits per 200 ha. Boundaries were based on the physiographic analysis in the field and interpolation of profile observations, and were plotted directly on topographic maps. In the second phase, photo-interpretation became a standard technique, with both panchromatic (scales from 1:14K to 1:33K) as well as infrared (scales from 1:10K to 1:17K) aerial photos being used. Boundaries were drawn manually on 1:50K topographic sheets with a 20-m contour interval. Inspection density was adjusted to one full profile and 10 to 30 augerings per 1000 ha to reduce survey costs and accelerate the survey. The resulting soil mapping units were almost always compound, having from two to four genetic soil types (Fig. 1b).

Control Surveys
We selected six map sheets (from a total of 185), performed three control surveys (each of an approximate size of 4 by 4 km) and redescribed 10 profiles of BSMC in the main landscape regions of Croatia. This was done to estimate the effective map scale, spatial accuracy of soil boundaries and thematic accuracy of profile observations (Table 1). Control surveys were small compared with the original data sets; they were, however, well distributed over the main geographical regions. We also used the Croatian soil profile database (Antonic et al., 2003) consisting of 2198 observations and the Digital Soil Map of Croatia, generalized to the scale of 1:300K (Bogunovic et al., 1998), to assess the sampling density and thematic contrast of soil mapping units.


View this table:
[in this window]
[in a new window]
 
Table 1. Adequacy aspects, data sources, and criteria used to evaluate them.

 
All spatial data were processed using ILWIS GIS (Unit Geo Software Development, 2001); the statistical analysis was done in S-Plus (MathSoft Inc, 1999). We also used ArcPad (Environmental Systems Research Institute [ESRI], 2000) for field navigation and initial data processing. This software was run on an iPAQ Compaq pocket PC, to which a GPS receiver (CRUX II GPS PCMCIA card) was attached, which made all together a light, compact, and reliable navigation system.

Profiles were described using the standard national soil survey methodology and the local classification system—Classification of Yugoslav Soils (CYS), which was used in BSMC and which is still in use in all republics of the former Yugoslavia (Bogunovic et al., 1998; Husnjak et al., 2006). Laboratory analyses were done in the Soil Science Department in Zagreb using the same methods as in the original survey.

Map Scale
The effective map scale was evaluated by estimating the average size delineation (ASD):

Formula 1[1]
where Aj is the area of the jth polygon and m is the total number of polygons (Forbes et al., 1982). The index of maximum reduction (IMR), that is, the factor by which the scale of the map could be reduced before ASD was equal to the minimum legible delineation (e.g., MLD—should be 0.4 cm2 on the map), was then derived by:

Formula 2[2]
From this, the effective scale number (ESN) was computed as (Forbes et al., 1982):

Formula 3[3]
where NSN is the nominal scale number.

To describe the general geometry of soil polygons, we used a shape complexity index S, which is the perimeter-to-boundary ratio:

Formula 4[4]
where P is the polygon perimeter, A is the polygon area, and r is the radius of the circle with the same surface area (Hole, 1978). A value of S close to 1 means that the polygon is rather compact and simple. Higher values describe narrower or more branching polygons, which often means higher positional accuracy and larger effective scale (D'Avello and McLeese, 1998).

Soil Boundaries
In the case of the national soil inventory in Croatia, all soil polygons were delineated manually following the concept of free survey, that is, using an irreproducible method. However, a careful study of the legend and comparison of the definitions of adjacent units make it possible to infer which soil boundaries, showing an obvious topographic break (e.g., abrupt change from a floodplain to a sloping hill) and a change in parent material, should have been followed (Wysocki et al., 2005). These primary boundaries, drawn independently by several surveyors, should definitively match within the soil survey standards (Bie and Beckett, 1973).

Maps of control surveys (photo-interpretation overlays) were georeferenced with an ortho-correction to horizontal precision of 3 to 12 m. The methodology is explained in detail in Rossiter and Hengl (2002). Spatial accuracy of soil boundaries was then assessed by delineating the area of disagreement (AD), which is the area of the polygon produced as the intersection between the original and control surveys. In this case, the ‘true’ line is assumed to be in the middle. Positional accuracy, that is, the mean absolute error (ME) can then be derived as half the average width of the AD:

Formula 5[5]
where l is the boundary length of the mapped delineations, and l' is the boundary length of the control delineation.

Profile Observations
Ten random profiles from the original soil survey with positions shown on soil maps were selected to assess how well the profile data corresponds to the control. We navigated to these points using the GPS-GIS system with the georeferenced original soil map in the background. It was always possible to be clearly within the square representing the original observation, as the profiles were shown by a 4-mm2 square on the soil map (100 x 100 m on the ground). The exact location of the control observation within the 1-ha square was determined in the field by experienced surveyors, who were looking for the same type of site as described in the original survey report. We then compared seven physical and chemical soil properties: sand, silt and clay contents (%), pH (H2O), pH (MKCl), organic matter (%), and carbonates (%) in all horizons, by calculating the root mean square error (RMSE) and normalized error (RMSE%):

Formula 6[6]

Formula 7[7]
where x is the given value of the soil attribute and x' is the control, n is the number of control measurements, {sigma}x is the global standard deviation for the whole study area, and R is the range (Ott and Longnecker, 2001). The dimensionless RMSE% allows a comparison of accuracy for variables of different types and with different ranges of variation (Park and Vlek, 2002). Values of RMSE% < 40% indicate a high correlation between the original and control measurements, while values close to 100% mean that we measured any equally probable value, which also means that the profile data are practically useless for spatial prediction. Note that the Eq. [7] is applicable to only the variables with a distribution close to normal. Otherwise a transformation needs to be applied.

Soil Mapping Units
A soil surveyor usually tries to delineate soil bodies in such a way that the contrast between adjacent soil mapping units (SMUs) is maximized, which reflects the idea of the maximum amount of information in a system. In the case of categorical data, separability of attribute values between mapping units is the key measure of the thematic map quality (Lilburne, 2002, p. 404–413). In soil resource inventories, the standard method of assessing classification efficiency is to compare the within-class variances with the between-class and total variances (Webster and Oliver, 1990, p. 63–70). Bishop et al. (2001) discussed some information-content criteria to optimize the choice of grid resolution for spatial interpolation. We decided to assess two aspects of the thematic quality of SMUs: (1) thematic purity or homogeneity of SMU composition and attribute values within the SMUs (Beckett and Burrough, 1971), and (2) thematic separability of geographically adjacent SMUs. These are different issues because SMUs can show imprecise distributions of attributes, while at the same time the thematic contrast between adjacent units can still be fairly high, and vice versa.

These two measures were assessed using 2198 profile observations and the 1:300K digital soil map of Croatia consisting of 65 SMUs. The mean value and standard deviation were calculated for each of the 65 SMUs of the 1:300K digital soil map and for three soil parameters: clay content (%), pH (measured in H2O), and organic matter (OM) in topsoil (%). The homogeneity within the SMUs was expressed using normalized standard deviation (see also Eq. [7]):

Formula 8[8]
where sx,j is the standard deviation of a xth property inside the jth SMU, k is the total number of units, and Rx is the range of variation.

Thematic separability of adjacent SMUs was assessed using thematic overlap (see also Lilburne, 2002, p. 404–413). This was calculated as the average probability of thematic overlap between geographically adjacent SMUs. xThis measure quantifies the uncertainty in attribute maps for site-specific decisions. If properties within units are normally distributed, the overlap between the two mapping units (µ1, {sigma}1) and (µ2, {sigma}2) can be quantified using the t test (Ott and Longnecker, 2001), with null hypothesis that the two samples belong to the same population:

Formula 9[9]
where P(x1 {cap} x2) is the normal probability of thematic overlap, Pn is the one-way normal cumulative distribution and x is the average value of the xth property. Finally, the average probability of overlap P{cap}(x) for all SMUs for a given property is:

Formula 10[10]
where m is the total number of SMUs. The lower the average probability of overlap, the more SMUs differ from one another, that is, the more contrasting are the delineations, and vice versa. If P{cap}(x) > 95%, there is no significant difference in attributes between adjacent SMUs, that is, we can measure similar properties within adjacent SMUs. This means that the SMUs are overspecified and can be simplified.

The neighboring SMUs (geographically adjacent polygon pairs) were derived in ILWIS using the neighbor polygon operation (Unit Geo Software Development, 2001). We then sorted the pairs of SMU polygons using the longest length of the neighborhood boundary between the SMUs and calculated the overlap using Eq. [9] and [10].

Usage and Usability
In a GIS, usability can be defined as the property of a given dataset that expresses (1) how well it helps users to arrive at a correct decision within their problem-solving context, and (2) how easily it can be accessed and made ready for use. This aspect is subjective and difficult to quantify. We decided to assess usability by applying three criteria:

a) How well can the product be integrated into an existing GIS?
b) How popular is the product—what is the number of users compared with the potential number of users, what is the degree of their satisfaction?
c) How easily can potential users access the product?

We first made a small inventory of all existing users and then performed unstructured interviews with several existing users in the land-use planning offices in the cities of Osijek, Karlovac, and Split. In addition, we discussed the cartographic and GIS issues with cartographic departments in major cities in Croatia. Finally, to see both sides of the story, we discussed the usability problems with the original surveyors.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 CONCLUSIONS
 REFERENCES
 
Lineage
The adequacy and data quality analysis was difficult because the data were not fully integrated and detailed metadata were missing. In some cases, we were able to understand the exact methodological steps used to produce maps only by talking to the surveyors involved. A good example is the problem of switching from the old to the new coordinate system, for which we could not find any information on maps. The soil map of Croatia was produced using old military 1:50K topomaps and had to be transformed to the new system of ground control points. This means that without the help of land surveyors, old soil maps cannot be accurately integrated into a GIS. We first overlaid digitized soil boundaries over the original georeferenced maps and concluded that the discrepancy could be estimated with a simple systematic shift. This example clearly shows how lack of metadata can lead to usability problems.

Logical Consistency and Completeness
As regards consistency and completeness, the national soil inventory shows a number of discrepancies, illustrated by the following two examples. Figure 2a shows how the calculated average density of mapped profiles per 1000 ha varies per map sheet, indicating rather different sampling densities in two parts of the country. The right part of the same figure shows printed and incomplete reports, that is, reports that are currently maintained only as working materials, such as sketches, drawings, handwritten notes, etc. (Fig. 2b).


Figure 2
View larger version (31K):
[in this window]
[in a new window]
 
Fig. 2. Two examples of methodological inconsistency (a) and incompleteness (b) of the national soil inventory in Croatia.

 
Effective Map Scale
The IMR for the 1:50K sheets ranged from 4 to 7, corresponding to an effective scale between 1:100K and 1:175K (see also supplementary materials for detailed evaluation). Also, the shape complexity index showed that the soil polygons in these six sheets were moderately simple, according to the classification of shape complexity proposed by Hole (1953, 1978). The IMR for the generalized 1:300K digital map was 1.9, which is almost ideal, showing that the effective scale corresponds to the given scale. However, polygons representing 1% of the total area were smaller than the MLD (360 ha) and had to be merged with adjacent polygons.

Inspection density for the 1:50K maps ranged from 0.7 to 2.2 profiles per 1000 ha, which is an order of magnitude lower than the suggested minimum of 50 (Avery, 1987; USDA–NRCS, 2003) for this scale, and two orders of magnitude lower than the ideal inspection density of four observations per map cm2, that is, 160 per 1000 ha. According to the original surveyors, the total inspection density was higher because there were up to 10 times more mini-pits that were visited but not recorded on the original map sheets. Ultimately, we decided not to use this information, since no record of it is available.

Although the soil maps and survey reports from the national inventory seem to be of high quality and with a lot of detail, it is clear that the aimed scale of 1:50K was not achieved in more than 95% of sampled map sheets. We estimated the effective scale to be about: (a) 1:150K based on the ASD; (b) 1:250K according to the inspection density; and (c) 1:150K according to the spatial accuracy of soil boundaries. Similarly, the shape complexity index showed rather simple geometries of delineations. Thus, the national soil inventory in Croatia can be classified as a small scale or medium intensity survey (Avery, 1987), which is not applicable for agricultural extension, civil engineering projects, or county level land-use planning.

Spatial Accuracy of Soil Boundaries
A comparison of soil boundaries in the original and control surveys is given in Fig. 3 . The original maps generally show less detail and follow the master lines only approximately. Only in the case of the "Kalinovac" area was the level of detail similar (Fig. 3c). In this case, we were very confident that the original surveyors should have exactly followed the master lines indicated on Fig. 3. The observed mean absolute error estimated at six evaluated master lines (±40 m) is about three times worse than the typical map accuracy standard for the 1:50K scale (Davies, 1981), which gives an effective map of 1:150K. The other secondary boundaries show even higher disagreement with the control surveys. Very often we could not conclude on which basis the surveyor had drawn the original boundaries. Some neighboring SMUs were described as consisting of the same soil types, often only with minor differences in composition. This makes many of the soil boundaries, other than the master lines, even more relative.


Figure 3
View larger version (35K):
[in this window]
[in a new window]
 
Fig. 3. Comparison of the original soil boundaries (left) and control survey areas (right): (a)"Gustirna", (b) "Popovac" and (c)"Kalinovac". The six master lines are bolded. In this case, we were very confident that the original surveyors should have followed the master lines on the right.

 
Thematic Accuracy of Profile Observations
Comparison of 10 detailed observations gave the impression that the profile data roughly corresponds to what was described in the field and measured in the laboratory. The results can be summarized as follows: (a) Descriptive data, such as exposition, land cover, rock outcrops, agreed in most cases with what we found in the field; (b) soil types did not exactly match the one found in the field in 4 of 10 cases.

Comparison of lab data showed a general correspondence with what we described in the field, for example, the texture class, clay content, and clay increase with an average normalized error of ±62.8% for analytical data (Table 2). The highest accuracy of measuring the same property was for organic matter (±34.8%), while the most inaccurate property was pH.


View this table:
[in this window]
[in a new window]
 
Table 2. Summary results on the thematic accuracy of point data and a comparison with empirical physical ranges of variables in Croatia. Ranges were estimated from the 2198 profiles data set as 95% ranges.

 
Accuracy of soil attributes attached to soil profiles (ground truth) was somewhat disappointing, quite close to complete inefficiency (100%). A soil map user, not necessarily familiar with the field of soil science, would expect to find the same soil types and measure similar soil attributes at the same point locations where the original profile observations were made. This is typically not the case in soil survey because local field variation is high. Moreover, a comparative work at ISRIC showed that even the RMSE in laboratory results of the same soil samples could easily exceed ±11% for clay content, ±0.2 units for pH and ±20% for cation exchange capacity (Van Reeuwijk, 1984). All this points to the conclusion that one cannot expect to measure the same values at control field sites as described in the database. There is still the problem of how to communicate this uncertainty to survey users (Goodchild, 2000).

Thematic Contrast between Soil Mapping Units
Analysis of the thematic contrast between SMUs with regard to clay content (%), pH, and OM % in topsoil showed that the SMUs from the 1:300K soil map are fairly heterogeneous (Table 3). The SMUs showed a high normalized standard deviation (s%), of 68% on average, for these three variables. Nevertheless, the analysis of variance showed that there were significant (p > 0.01) differences between the 65 SMUs.


View this table:
[in this window]
[in a new window]
 
Table 3. Summary results for the thematic contrast of SMUs for the 1:300K soil map based on clay content, pH, and OM.

 
The geographically adjacent SMUs showed an average 66% overlap probability between neighboring SMUs (Table 3). Ideally, normalized variation should be <40% and the probability of thematic overlap <5%. These values indicate that the effective contrast of the 1:300K soil map is relatively low, which does not have to be due to the poor delineations or legends. This is probably a result of the relatively general scale. The derived attribute maps for clay content and relative variation within the units are shown in Fig. 4a and c. Areas of higher s% (e.g., >100%), shown as darker areas (Fig. 4c), are inefficient for the production of attribute maps. Note that the normalized variation is a somewhat biased measure of homogeneity because the values close to zero typically have a lower variance.


Figure 4
View larger version (62K):
[in this window]
[in a new window]
 
Fig. 4. Attribute map of (a) clay content (%),(b) histogram, map of relative variation within SMUs (c), and two examples of high and low thematic overlap between neighboring SMU pairs– density histograms produced using the S-Plus package (d). P is the average probability of thematic overlap (P{cap}(x)).

 
Note that we have evaluated only three soil properties. Determining thematic overlap on the basis of only a few soil properties may suggest greater thematic overlap than actually exists if all soil properties are considered. In ideal situation, one should try to evaluate thematic overlap for all measured soil properties and then analyze average thematic overlap and its variation.

Usability Aspects
We concluded from our interviews that most of the government departments involved in physical planning, agricultural extension, and environmental protection are not using the existing soil data to their fullest potential. The problem appears to be two-fold. First, most map units are compound and map users (planners or extensionists) are rarely capable of finding the SMU components in the field solely on the basis of their landscape relations. Second, there are no interpretations about suitability/limitations for a specific land-use system.

The principal small-scale users of soil data in Croatia are: (i) Croatian Waters, a government agency, (ii) county planning offices (8 of 21), and (iii) departments of the Ministry of Nature Protection and Physical Planning. Together these account for only about one quarter of all users that might benefit from soil geoinformation.

Finally, we have identified the three main causes that inhibit the growth of applications:


    CONCLUSIONS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 CONCLUSIONS
 REFERENCES
 
In the sections above, we have presented a methodological framework for evaluating the adequacy and usability of traditional soil maps based on concrete statistical measures. The final checklist of the suggested measures for estimating the true adequacy and usability of soil maps is given in Table 4. This aspect of soil survey should deserve more exposure in the coming years, since the results of our case study confirm that soil maps are often of lower quality than planned. The remaining open issues are discussed below.


View this table:
[in this window]
[in a new window]
 
Table 4. Checklist of the recommended criteria to evaluate the adequacy and usability of soil maps.

 
Assessing Usability
The reasons why soil data in Croatia are rarely used, and often only descriptively, are more complex than an adequacy analysis can show. We have discovered that users' satisfaction with current products depends mainly on how well their professional background allows them to make their own interpretations. Preconceptions from the users' own field of expertise color their perceptions of soil data. For example, land surveyors and GIS professionals were put off by the fact that boundaries in adjacent map sheets do not match (Fig. 5 ). This reduces their confidence in the product, even if other quality elements are good.


Figure 5
View larger version (41K):
[in this window]
[in a new window]
 
Fig. 5. Mismatch between the boundaries in adjacent map sheets. Note that most of the adjacent soil mapping units have also showed different topologies. Problems like this can seriously reduce confidence in the soil survey products.

 
Although more and more technical measures are being introduced to quantify the adequacy of soil geoinformation, a methodology that could be used to quantify ‘usability’, that is, to objectively measure usability, still needs to be addressed. Is this merely a question of the number of users and their satisfaction? How to adjust the soil survey products to fit users' level of expertise? How do the price and accessibility of products affect the usability of SIS products and how could the usability of an existing SIS be improved? The next step will be to design and conduct more structured interviews with users to obtain more objective criteria of users' satisfaction and integrity of this data set. It appears that the users' perspective is the crucial aspect here, so that even the assessment of the soil map quality needs to be driven by criteria that are important to users.

Why Are Soil Maps Not Used?
The quality and usefulness of polygon-type soil maps (area partitions) has for decades been a subject of argument (Webster and Beckett, 1968; Groot, 1993). Many GIS professionals working on data integration claim that the critical layer in a multi-thematic GIS, particularly when utilized for land management decisions, is soil survey information (Maclean et al., 1993). Vegetation, relief, land cover, geological, and other maps, on the other hand, have been considered to be easier to interpret and use by GIS users than maps of soil types. There are several probable reasons why soil maps are so unpopular outside soil science: (1) the concept of soil types cannot be compared with more clearly identifiable individuals such as plant species since soil bodies are hidden, often mixed and fuzzy (Burrough et al., 1997), not to mention the problem of too many active soil classification systems used in the world; (2) reproducible analytical procedures are missing in some phases of soil mapping, for example, during photo-interpretation. Because of this, the soil survey profession is still considered, by some, to be more of an art than a science (Hudson, 1992).

Many usability problems—lack of metadata, inconsistent methodology, incompleteness, unpopular concepts used—discovered in this case study are typical of national inventories conducted in Eastern European countries after the Second World War but also in some more developed countries. This, however, does not mean that new soil maps need to be produced from scratch or that this data is completely unusable. One solution to save this large amount of high quality soil field data is to use auxiliary maps of terrain morphology, remote sensing images, and new quantitative techniques, to produce more accurate prediction maps.


    ACKNOWLEDGMENTS
 
The authors thank the Croatian Ministry of Science and the International Institute for Geo-Information Science and Earth Observation (ITC) for funding and supporting this research. We also thank Dr. D.G. Rossiter, former head of the ITC Soil Science Division, for his comments, suggestions and valuable discussion on the statistical measures of adequacy; Prof. Dr. M. Bogunovic of the Department of Soil Science, University of Zagreb, and Dr. N. Pernar of the Faculty of Forestry in Zagreb, who provided the digital soil database with 2198 full profile observations.

Received for publication April 19, 2004.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 CONCLUSIONS
 REFERENCES
 





This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hengl, T.
Right arrow Articles by Husnjak, S.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Hengl, T.
Right arrow Articles by Husnjak, S.
Agricola
Right arrow Articles by Hengl, T.
Right arrow Articles by Husnjak, S.
Related Collections
Right arrow Soil Methods/Instrumentation


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
The SCI Journals Agronomy Journal Crop Science
Journal of Natural Resources
and Life Sciences Education
Vadose Zone Journal
Journal of Plant Registrations Journal of
Environmental Quality
The Plant Genome