|
|
||||||||
a Dep. of Agronomy, Iowa State Univ., Ames, IA 50011
b USDA-ARS, National Soil Tilth Laboratory, 2150 Pammel Drive, Ames, IA 50011
c USDA-NRCS, Soil Survey and Resource Assessment, P.O. Box 2890, 14th Independence Ave. S.W., Washington, DC 20250
d Jr., Dep. of Agricultural & Biosystems Engineering, Iowa State Univ., Ames, IA 50011
Corresponding author (laird{at}nstl.gov)
| ABSTRACT |
|---|
|
|
|---|
0.50). The predicted results for aggregation (wt% > 2, 1, 0.5, 0.25 mm, and macroaggregation) were not reliable (r2 = 0.46
0.60). Mehlich III extractable Cu, P, and Zn, and exchangeable Na could not be predicted using the NIRSPCR technique (r2 < 0.50). The results indicate that NIRS can be used as a rapid analytical technique to simultaneously estimate several soil properties with acceptable accuracy in a very short time.
Abbreviations: CEC, cation-exchange capacity ICP-AES, inductively coupled plasma-atomic emission spectroscopy LWR, locally weighted regression MLRA, major land resource area NIRS, near-infrared reflectance spectroscopy PC, principal component PCR, principal components regression PLSR, partial least squares regression RMSECV, root mean standard error of cross validation RPD, the ratio of standard deviation to RMSECV SMLR, stepwise multiple linear regression SQ-NRI, soil quality-natural resource inventory
| INTRODUCTION |
|---|
|
|
|---|
Near-infrared reflectance spectroscopy is a nondestructive analytical technique for studying interactions between incident light and a material's surface. Near-infrared reflectance spectroscopy is widely used in industry due to its simplicity, rapidness, and the need for little or no sample preparation. The technique was first developed more than three decades ago for rapid moisture analysis of grain (Ben-Gera and Norris, 1968). Now NIRS is the dominant analytical technique used for grain and forage quality assessments. Near-infrared reflectance spectroscopy is also used as an identification and/or characterization technique in the polymer, pharmaceutical, petrochemical, and other industries (Wetzel, 1983; Creaser and Davies, 1988a; Murray and Cowe, 1992; Workman, 1996).
Near-infrared spectra are dominated by weak overtones and combinations of fundamental vibrational bands for H-C, H-N, and H-O bonds from the mid-infrared region. In addition to the chemistry of a material, near-infrared spectra are also influenced by the physical structure of a material. The size and shape of the particles, the voids between particles, and the arrangement of particles affect the length of the light transmission passing through a sample and thereby influence reflectance (Wetzel, 1983). Near-infrared spectra are difficult to interpret directly because of the overlap of weak overtones and combinations of fundamental vibrational bands. As a result, multivariate calibration is required for quantitative analysis of sample constituents by NIRS.
Various calibration methods have been used to relate near-infrared spectra with measured properties of materials. Principal components regression, partial least squares regression (PLSR), stepwise multiple linear regression (SMLR), Fourier regression, locally weighted regression (LWR) and artificial neural networks are the most used multivariate calibration techniques for NIRS (Creaser and Davies, 1988b; Naes and Isaksson, 1990; Holst, 1992). None of these proposed calibration techniques have achieved universal acceptance because a calibration model that works well for one application may be unacceptable for another.
Several studies have focused on measuring soil properties using NIRS. Bowers and Hanks (1965) concluded that reflectance spectra are strongly affected by soil moisture content, organic matter content, and particle size. Al-Abbas et al. (1972) found that light reflectance is negatively correlated with organic matter and clay content. Krishnan et al. (1980) compared analyses based on reflectance at two wavelengths in the visible light region (623.3 and 564.4 nm) and two wavelengths in the near-infrared region (1136.0 and 1398.4 nm) for predicting soil organic matter content of 12 soils from Illinois (r2 = 0.92 for visible light, and r2 = 0.87 for infrared light). One hundred forty-four samples collected from three soil series in Queensland, Australia (six depth-intervals for eight profiles of each soil series) were analyzed in the study of Dalal and Henry (1986). They used reflectance at three wavelengths, in the form of log(1/R), to predict total organic C, total N, and moisture content by multiple linear regression (r2 = 0.86, 0.86, and 0.92, respectively). Using similar approaches, Morra et al. (1991) concluded that NIRS could be used to predict soil C and N content.
Henderson et al. (1992) found that reflectance of organic matter extracted from four Indiana agricultural soils strongly correlated with organic C content and significantly responded to concentrations of Fe and Mn oxides in the visible range for soils having the same parent material. Fritze et al. (1994) studied reflectance spectra of fire- or wood ash-treated humus samples, and found that the first two regression components (based on PLSR) obtained from spectroscopic characterization could explain 60 to 80% of the biological variation (soil respiration and microbial biomass). The prediction ability of NIRS for soil N availability was compared with other tests by Fox et al. (1993). A portable near-infrared spectrophotometer, designed by Sudduth and Hummel (1993a)( 1993b), was used to predict soil organic matter (r2 > 0.85), moisture (r2 > 0.94), and CEC (r2 > 0.85) in soils from Illinois. They also concluded that the predictions of these soil properties became less accurate as the geographic range of samples increased (Sudduth and Hummel, 1996).
Most NIRS studies related to prediction of soil properties were limited in one way or another due to small sample size, less diversity in soil types, and/or because only a few soil properties were tested. In this study, a diverse group of 802 soil samples collected from four MLRAs were analyzed by NIRS. The objectives of this study were (i) to evaluate the ability of NIRS to predict various soil properties and (ii) to understand why NIRS can be used to predict some soil properties that theoretically do not respond to light in the near-infrared region.
| MATERIALS AND METHODS |
|---|
|
|
|---|
3 or 0
10 cm) and subsurface (3
10 or 10
30 cm) soils were collected from 448 sites in the four MLRAs, including MLRA 9 (the Palouse and Nez Perce Prairies located in eastern Washington and western Idaho), MLRA 67 (the Central High Plains located in eastern Colorado, southeastern Wyoming, and western Nebraska), MLRA 77 (the Southern High Plains located in New Mexico and the panhandle of Texas), and MLRA 105 (the Northern Mississippi Valley Loess Hills, located in northeastern Iowa, southeastern Minnesota, and southwestern Wisconsin). More than 800 soil samples were collected and field observations were recorded at each site. The soil samples were analyzed for physical, chemical, and biological properties by the cooperating laboratories, including the NRCS, Soil Characterization Laboratory in Lincoln, NE, and four ARS and university laboratories located in Ames, IA; Pullman, WA; St. Paul, MN; and Bushland, TX. The soil properties tested by NIRS and the analytical methods used are summarized in Table 1. The basic statistics of soil properties are summarized in Table 2. Some samples did not have complete soil property data, so the real number of samples used in the NIRS analysis could be smaller than 800.
|
|
100 g of air-dried soil was packed into a natural product cell having a quartz window, and the spectral reflectance, averaged from 25 spectra, was recorded as the logarithm of the inverse of the reflectance, or optical density [log(1/R)], at 2-nm intervals from 400 to 2498 nm. In order to evaluate the application of NIRS for soil testing under more realistic and practical conditions, the <8-mm sieved soil samples were analyzed by NIRS for this study. Although some soil properties were measured using samples passing a 2-mm sieve while the near-infrared spectra were obtained with samples passing an 8-mm sieve, the discrepancy should have little affect on the NIRS predictions as long as the procedures were consistent.
Near-Infrared Reflectance Spectroscopy Prediction
A PCR technique was used to relate the near-infrared reflectance spectra to the measured soil properties. The NIRSPCR technique, summarized in Fig. 1
, contained four steps: (i) data pretreatment, (ii) calibration set selection, (iii) principal component regression and prediction, and (iv) prediction ability evaluation.
|
![]() | (1) |
The selected range of spectra includes three major reflectance peaks; the intense peak in the 400- and 1300-nm range was not included because it was found to reduce the accuracy of predicted soil properties using this calibration model.
Calibration Set Selection
In order to evaluate the ability of NIRS to predict soil properties, spectral data for all soil samples were treated the same during the computation procedures. A database for all 802 samples containing the transformed and truncated first derivative spectra as well as measured values for the soil properties was established. The calibration strategy used in this study was to first select a small (n = 30) subset of similar (having similar spectra) samples for each sample being tested, and then to use PCR to predicted the value of the soil property for the test sample.
The 30 samples used in the calibration set for a given sample were selected from all of those in the database (excluding the sample being tested) based on the shortest squared Euclidean distance to the derivative reflectance spectra for the test sample. Squared Euclidean distance between two reflectance spectra can be obtained by
![]() | (2) |
Principal Components Regression and Prediction
For the calibration set, the values of a soil property (y30x1) can be expressed as a linear function of their spectral reflectance, such as
![]() | (3) |
Prediction Ability
Up to 20 principal components were used in the regression calculations, the number of principal components (F) was chosen to give the smallest root mean standard error of cross validation (RMSECV), largest r2, and a slope close to one for the regression line between predicted and measured values of soil properties. The ability of the NIRSPCR technique to predict a soil property was evaluated using r2, RMSECV, and the ratio of standard deviation to RMSECV (RPD).
In this study, eigenvectors were obtained from singular value decompositions, and all calculations were performed using MATLAB (The Mathworks, Inc., Natick, MA).
Property Equation
Near-infrared reflectance spectra are directly influenced by combinations and overtones of fundamental vibrations for organic functional groups and water, particle size, and surface properties. Therefore, total C, total N, moisture content, particle size, and aggregation are considered primary properties, because a theoretical basis for NIRS predictions of these properties is apparent. Other soil properties are considered secondary properties. If a secondary property is correlated with one or more of the primary properties, the secondary property may also be predicted by NIRS even though the secondary property does not respond directly to near-infrared light. For instance, potentially mineralizable N is related to total organic C and total N, and CEC is correlated with clay abundance and organic matter content. Previous studies have found that NIRS can predict some soil properties not theoretically related to near-infrared light (Fox et al., 1993; Fritze et al., 1994; Ben-Dor and Banin, 1995). This phenomenon was studied by comparing the predictive ability of the NIRSPCR technique for secondary soil properties to their level of correlation with primary soil properties.
| RESULTS AND DISCUSSION |
|---|
|
|
|---|
800 nm), and three major absorption peaks (around 1400, 1900, and 2200 nm) in the near-infrared light region. Mean spectra for soils from the four MLRAs shown in Fig. 2
were obtained using only samples with low moisture content (<0.01 kg kg-1) in an effort to reduce the influence of water and to emphasize the essential characteristics of the reflectance spectra. In the near-infrared region, the mean spectra for MLRA 67 and MLRA 77 had more intense peaks than the mean spectra for MLRA 9 and MLRA 105. The mean spectrum of MLRA 77 had the highest optical density in the visible light range. Mean spectra for MLRA 9 and MLRA 105 had different basal lines, but both had weak peaks in the near-infrared light region.
|
|
The first step in the calibration procedure used in the NIRSPCR technique was the selection of 30 neighboring samples for the calibration set, based on the smallest squared Euclidean distance between the measured first derivative spectra for the first derivative test samples and the spectra for any of the other samples in the database. Generally, soils from the same area have similar soil properties (such as size and shape of aggregates) and similar responses to incident light. Therefore, selecting similar spectra should help to reduce the influence of physical variations. One means of testing the viability of this approach was to determine the extent of regional bias that occurred during selection of samples for the calibration set. To do so, we defined q as the probability that samples in the calibration set are from the same MLRA as the test sample
![]() | (4) |
|
Soil Properties and Reflectance Spectra
Soil is a heterogeneous mixture of various chemical compounds, and thus a unique spectral response for soil properties is by no means certain. One method of evaluating the spectral response for a soil property is to study the relationship between wavelength, optical density, and the values of the soil property. The relationship between the first derivatives of optical density and measured values for some soil properties (total C, total N and moisture content, biochemical properties, and macroaggregation and particle size) in the visiblenear-infrared light region are shown in Fig. 4
. Total C and total N had similar responses, but the response for soil moisture was unique. Carbon and N are major elements in soil organic matter, and quantities of C and N in soils are highly correlated. Some biochemical soil properties (such as potential mineralizable N, respiration rate, and biomass C) and CEC also have similar spectral responses, though less intense, to that of total organic C and total N. The similarity in spectral response for C, N, and other biological properties is probably due to their high intercorrelation (Brejda et al., 2000a, b). In contrast, water contains -OH groups, which clearly have a unique spectral response in the near-infrared region. Soil particle-size distribution and macroaggregation also exhibited a unique spectral response to incident light.
|
The ability of NIRS to predict the 33 soil properties is summarized in Table 4. Samples having difference between measured and predicted values larger than three times RMSECV were considered outliers and were excluded from the analysis. For most tested soil properties, more than 97.3% of soil samples were included for evaluating the prediction ability of NIRS. Scatter plots of predicted vs. measured values for some properties are shown in Fig. 5 .
|
|
2.0) includes soil properties with measured vs. predicted r2 values between 0.50 and 0.80. This group includes clay, potentially mineralizable N, total respiration rate, biomass C, pH, some wet aggregation measures (macro-, 1.0, and 0.5 mm), some Mehlich III extractable metals (Fe, K, Mg, Mn), NH4OAc extractable cations (Ca, Mg, K), and titratable acidity. Mehlich III extractable Cu, P, and Zn; NH4OAc extractable Na; and some wet aggregation measurements (2 and 0.25 mm) are in Category C (r2 < 0.50, RPD < 1.4). The authors believe that prediction of soil properties in Category B can be improved by using different calibration strategies, but properties in Category C may not be reliably predicted using NIRS.
The results indicate that total C, total N, and moisture content were readily and accurately estimated (r2 > 0.84, RPD > 2.47). The slopes of the measured vs. predicted regression lines for total C, total N, and moisture content are not significantly different from 1 which indicates that NIRSPCR did not tend to over- or underestimate these properties. In other studies of NIRS analysis of soils, the r2 values for measured vs. predicted water content are higher than 0.9 (Dalal and Henry, 1986; Sudduth and Hummel, 1993). The lower r2 value obtained in this study was probably due to the small range in moisture content of the air-dried samples (range = 0.00
0.17, mean = 0.02 kg kg-1).
The size, shape, and arrangement of particles in a sample can affect the path of light transmission and the reflectance spectra, as such NIR spectra are assumed to exhibit a primary response to soil texture and structure. Based on the results, NIRS can be used to predict measured sand and silt content (r2 > 0.82; RPD > 2.32) more accurate than measured clay (r2 = 0.67; RPD = 1.71). Predictions of measured aggregation measurements by NIRS, on the other hand, are less reliable (r2 < 0.6; RPD < 1.58). The poor performances of NIRSPCR in aggregation may be due to artifacts related to sample handling, and/or the calibration model used may not be suitable for analyzing these soil properties. The use of first derivatives of near-infrared reflectance data used in this NIRSPCR technique may remove some of particle size influence. However, use of the original log(1/R) data with the PCR technique did not improve results. Another possible explanation for the poor performance of the NIRSPCR technique in predicting measures of aggregation may be that these measures did not accurately represent the shape and size of particles and voids in the samples.
Several soil properties that do not have a primary response in the near-infrared region, such as CEC and 1.5 MPa water, were accurately predicted by the NIRSPCR technique (r2 > 0.80; RPD > 2.28). Correlation of these properties with soil organic matter and clay contents may explain some of this effect. Near-infrared reflectanceprincipal components regression analysis is also relatively accurate for predicting levels of Mehlich III extractable cations (Ca, Mg, K, Fe, and Mn). The ability of the NIRSPCR technique to predict levels of extractable cations may be due to covariance of these properties with soil properties exhibiting a primary response in the near-infrared region. Generally, NIRSPCR analyses were more accurate for predicting cations extracted by the Mehlich III method than the NH4OAc method. The reasons for this difference are not clear.
The ability of the NIRSPCR technique to predict soil biochemical properties varied (potentially mineralizable N, r2 = 0.72, RPD = 1.84; total respiration rate, r2 = 0.66, RPD = 1.70; basal respiration rate, r2 = 0.82, RPD = 2.31; and biomass C, r2 = 0.60, RPD = 1.50). Values of the biochemical properties and the accuracy of the NIRSPCR predictions are affected by the levels and nature of soil organic matter. For example, soil samples from MLRA 77 have a lower mean total C content and a narrower range (mean = 4.2, range = 1.9
11.1 g kg-1) than the soils from MLRA 105 (mean = 34.2, range = 5.5
285.8 g kg-1). The ability of the NIRSPCR technique to predict biomass C and basal respiration rate for soils from MLRA 77 was very low (r2 < 0.02), whereas these predictions were much more accurate for soil samples from MLRA 105 (r2 = 0.66 and 0.80, respectively). In general, the regression coefficients for other soil properties for samples from MLRA 77 are lower than regression coefficients for samples from other MLRA groups. These differences suggest that organic matter content had a large effect on the accuracy of NIRSPCR predictions for many soil properties.
In addition to abundance, the nature of soil organic matter also affects biochemical properties of soils. Soil organic matter is composed of large and complex organic polymers. Abundance and distributions of the various organic functional groups may influence both the biochemical properties and the NIR spectra. For example, potentially mineralizable N measures the N that is mineralized during a 35-d incubation. Soil organic matter that contains a large amount of N in readily decomposable proteins will have higher potentially mineralizable N levels than soils with large amounts of N in more recalcitrant heterocycles. Respiration rate may also depend on the nature of organic functional groups. Unfortunately, distinguishing soil organic functional groups using NIR spectra at this stage is difficult.
Near-Infrared Reflectance Spectroscopy Principal Components Regression Predictions of Secondary Properties
Many soil properties with a secondary response in the near-infrared red could be predicted using NIRSPCR (Table 4). The ability of NIRSPCR to predict these properties may be due to correlations with soil properties having a primary response in the near-infrared light region. To test this hypothesis, we compared the predictions of secondary properties by multiple linear regression using the primary properties as independent variables (Method A) with predictions using the NIRSPCR technique (Method B). Total N and silt contents were not included in the multiple linear regression of Method A because of the strong correlation between total C (r = 0.95) and sand contents (r = -0.97), respectively. The analysis (Table 5) indicates that in general, when high regression coefficients were obtained by multiple linear regression (Method A), high regression coefficients were also obtained using the NIRSPCR technique. For instance, CEC was readily predicted by multiple linear regression using moisture, total C, particle-size distribution, and macro-aggregation (r2 = 0.89), and therefore it was not surprising that CEC was also accurately predicted by NIRSPCR (r2 = 0.81). Mehlich III extractable Cu, on the other hand, was not correlated with any of the primary properties, and the regression coefficients for Methods A and B were both low (0.00 and 0.25, respectively). However, the ability of the NIRSPCR technique to predict some secondary properties cannot be explained by covariance with primary soil properties. Mehlich III extractable K is one example. The regression coefficient between the measured and predicted values based on Method A was low (0.13), but the regression coefficient for the NIRSPCR technique was 0.64. The pH measured in H2O and CaCl2 were also more accurately predicted by NIRSPCR than would be expected from covariance with primary soil properties. This discrepancy may be due to the inability of multiple linear regression to accurately represent the relationship between primary and secondary soil properties, and/or that other soil properties not measured may influence the NIR spectra.
|
| CONCLUSIONS |
|---|
|
|
|---|
| NOTES |
|---|
|
|
|---|
Received for publication January 13, 2000.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
L. Wielopolski, G. Hendrey, K. H. Johnsen, S. Mitra, S. A. Prior, H. H. Rogers, and H. A. Torbert Nondestructive System for Analyzing Carbon in the Soil Soil Sci. Soc. Am. J., September 1, 2008; 72(5): 1269 - 1277. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Tranter, B. Minasny, A. B. McBratney, R. A. V. Rossel, and B. W. Murphy Comparing Spectral Soil Inference Systems and Mid-Infrared Spectroscopic Predictions of Soil Moisture Retention Soil Sci. Soc. Am. J., August 20, 2008; 72(5): 1394 - 1400. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Wu, J. Chen, J. Ji, P. Gong, Q. Liao, Q. Tian, and H. Ma A Mechanism Study of Reflectance Spectroscopy for Investigating Heavy Metals in Soils Soil Sci. Soc. Am. J., May 16, 2007; 71(3): 918 - 926. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Guerrero, J. Mataix-Solera, V. Arcenegui, J. Mataix-Beneyto, and I. Gomez Near-Infrared Spectroscopy to Estimate the Maximum Temperatures Reached on Burned Soils Soil Sci. Soc. Am. J., May 16, 2007; 71(3): 1029 - 1037. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. M. Mouazen, R. Karoui, J. De Baerdemaeker, and H. Ramon Characterization of Soil Water Content Using Measured Visible and Near Infrared Spectra Soil Sci. Soc. Am. J., June 21, 2006; 70(4): 1295 - 1302. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Stevens, B. van Wesemael, G. Vandenschrick, S. Toure, and B. Tychon Detection of Carbon Stock Change in Agricultural Soils Using Spectroscopic Techniques Soil Sci. Soc. Am. J., March 29, 2006; 70(3): 844 - 850. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J. Cohen, J. P. Prenger, and W. F. DeBusk Visible-Near Infrared Reflectance Spectroscopy for Rapid, Nondestructive Assessment of Wetland Soil Quality J. Environ. Qual., July 5, 2005; 34(4): 1422 - 1434. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. K. Sorensen and S. Dalsgaard Determination of Clay and Other Soil Properties by Near Infrared Spectroscopy Soil Sci. Soc. Am. J., January 1, 2005; 69(1): 159 - 167. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. D. Shepherd and M. G. Walsh Development of Reflectance Spectral Libraries for Characterization of Soil Properties Soil Sci. Soc. Am. J., May 1, 2002; 66(3): 988 - 998. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| The SCI Journals | Agronomy Journal | Crop Science | |||
| Journal of Natural Resources and Life Sciences Education |
Vadose Zone Journal | ||||
| Journal of Plant Registrations | Journal of Environmental Quality |
The Plant Genome | |||