TY - JOUR

T1 - Reduction of bias from parameter variance in geophysical data estimation

T2 - Method and application to ice water content and sedimentation flux estimated from LiDar

AU - Bolot, Maximilien

AU - Fueglistaler, Stephan

N1 - Funding Information:
Acknowledgments. This material is based upon work supported by the National Science Foundation under Grants AGS-1417659 and AGS-1743753.
Publisher Copyright:
© 2020 American Meteorological Society.

PY - 2020/3/1

Y1 - 2020/3/1

N2 - This paper addresses issues of statistical misrepresentation of the a priori parameters (henceforth called ancillary parameters) used in geophysical data estimation. Parameterizations using ancillary data are frequently needed to derive geophysical data of interest from remote measurements. Empirical fits to the ancillary data that do not preserve the distribution of such data may induce substantial bias. A semianalytical averaging approach based on Taylor expansion is presented to improve estimated cirrus ice water content and sedimentation flux for a range of volume extinction coefficients retrieved from spaceborne lidar observations by CALIOP combined with the estimated distribution of ancillary data from in situ aircraft measurements of ice particle microphysical parameters and temperature. It is shown that, given an idealized distribution of input parameters, the approach performs well against Monte Carlo benchmark predictions. Using examples with idealized distributions at the mean temperature for the tropics at 15 km, it is estimated that the commonly neglected variance observed in in situ measurements of effective diameters may produce a worst-case estimation bias spanning up to a factor of 2. For ice sedimentation flux, a similar variance in particle size distributions and extinctions produces a worst-case estimation bias of a factor of 9. The value of the bias is found to be mostly set by the correlation coefficient between extinction and ice effective diameter, which in this test ranged between all possible values. Systematic reporting of variances and covariances in the ancillary data and between data and observed quantities would allow for more accurate observational estimates.

AB - This paper addresses issues of statistical misrepresentation of the a priori parameters (henceforth called ancillary parameters) used in geophysical data estimation. Parameterizations using ancillary data are frequently needed to derive geophysical data of interest from remote measurements. Empirical fits to the ancillary data that do not preserve the distribution of such data may induce substantial bias. A semianalytical averaging approach based on Taylor expansion is presented to improve estimated cirrus ice water content and sedimentation flux for a range of volume extinction coefficients retrieved from spaceborne lidar observations by CALIOP combined with the estimated distribution of ancillary data from in situ aircraft measurements of ice particle microphysical parameters and temperature. It is shown that, given an idealized distribution of input parameters, the approach performs well against Monte Carlo benchmark predictions. Using examples with idealized distributions at the mean temperature for the tropics at 15 km, it is estimated that the commonly neglected variance observed in in situ measurements of effective diameters may produce a worst-case estimation bias spanning up to a factor of 2. For ice sedimentation flux, a similar variance in particle size distributions and extinctions produces a worst-case estimation bias of a factor of 9. The value of the bias is found to be mostly set by the correlation coefficient between extinction and ice effective diameter, which in this test ranged between all possible values. Systematic reporting of variances and covariances in the ancillary data and between data and observed quantities would allow for more accurate observational estimates.

UR - http://www.scopus.com/inward/record.url?scp=85082882882&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85082882882&partnerID=8YFLogxK

U2 - 10.1175/JAS-D-19-0106.1

DO - 10.1175/JAS-D-19-0106.1

M3 - Article

AN - SCOPUS:85082882882

VL - 77

SP - 835

EP - 857

JO - Journals of the Atmospheric Sciences

JF - Journals of the Atmospheric Sciences

SN - 0022-4928

IS - 3

ER -