Accurately forecasting ozone levels that exceed specific thresholds is pivotal for mitigating adverse effects on both the environment and public health. However, predicting such ozone exceedances remains challenging due to the infrequent occurrence of high-concentration ozone data. This research, leveraging data from 57 German monitoring stations from 1999 to 2018, introduces an Enhanced Extreme Instance Augmentation Random Forest (EEIA-RF) approach that significantly improves the prediction of days when the maximum daily 8-hour average ozone concentrations exceed 120μg/m³. A pre-trained machine learning model is used to generate additional high-concentration data, which, combined with selectively reduced low-concentration data, forms a new dataset for training a refined model. This method achieved an improvement of at least 8% in the accuracy of predicting days with ozone exceedances across Germany. Our experiment underscores the approach's value in enhancing atmospheric modeling and supporting public health advisories and environmental policy-making related to ozone pollution.

The chemical transport model LOTOS-EUROS uses a volatility basis set (VBS) approach to represent the formation of secondary organic aerosol (SOA) in the atmosphere. Inclusion of the VBS approximately doubles the dimensionality of LOTOS-EUROS and slows computation of the advection operator by a factor of two. This complexity limits SOA representation in operational forecasts. We develop a mass-conserving dimensionality reduction method based on matrix factorization to find latent patterns in the VBS tracers that correspond to a smaller set of superspecies. Tracers are reversibly compressed to superspecies before transport, and the superspecies are subsequently decompressed to tracers for process-based SOA modeling. This physically interpretable data-driven method conserves the total concentration and phase of the tracers throughout the process. The superspecies approach is implemented in LOTOS-EUROS and found to accelerate the advection operator by a factor of 1.5–1.8. Concentrations remain numerically stable over model simulation times of 2 weeks, including simulations at higher spatial resolutions than the data-driven models were trained on. The reversible compression of VBS tracers enables detailed, process-based SOA representation in LOTOS-EUROS operational forecasts in a computationally efficient manner. Beyond this case study, the physically consistent data-driven approach developed in this work enforces conservation laws that are essential to other Earth system modeling applications, and generalizes to other processes where computational benefit can be gained from a two-way mapping between detailed process variables and their representation in a reduced-dimensional space.

Super dust storms re-occurred over East Asia in 2021 spring and casted great health damages and property losses. It is essential to achieve an accurate dust forecast to reduce the damage for early warning. The forecasting system fundamentally relies on a numerical model which can forecast the full evolution of dust storms. However, large uncertainties exist in model forecasts. Meanwhile, various near-real-time observations are available that contain valuable dust information. A dust storm forecasting system is here developed through coupling a chemical transport model, LOTOS-EUROS, and Localized EnKF (LEnKF) assimilation approach. The assimilations are carried out via an interface of our self-designed assimilation toolbox, PyFilter v1.0. Ground-based PM₁₀ measurements from air quality monitoring network are assimilated. Sequential assimilation tests are carried out over the 2021 spring super dust storms. The results show that the assimilation-based forecasting system produces a promising dust forecast than model-only forecast, and the improvements is also validated through comparing to the independent MODIS aerosol optical depth (AOD). Superior performance is obtained when LEnKF is implemented, as the localization helps EnKF in resolving the PM₁₀ measurements that have a large spatial variability with limited ensemble members. In addition, sensitivity experiments are conducted to exploit the distance-dependent localization for the LEnKF. Considering both cases, the optimal choice of the distance is tested to be around 500 km: the larger distance is less effective in removing the spurious correction, while the smaller one easily falls into the local optimum and the model would become divergent rapidly.

Last spring, super dust storms reappeared in East Asia after being absent for one and a half decades. The event caused enormous losses in both Mongolia and China. Accurate simulation of such super sandstorms is valuable for the quantification of health damage, aviation risks, and profound impacts on the Earth system, but also to reveal the climatic driving force and the process of desertification. However, accurate simulation of dust life cycles is challenging, mainly due to imperfect knowledge of emissions. In this study, the emissions that lead to the 2021 spring dust storms are estimated through assimilation of MODIS AOD and ground-based PM10 concentration data simultaneously. With this, the dust concentrations during these super storms could be reproduced and validated with concentration observations. The multi-observation assimilation is also compared against emission inversion that assimilates AOD or PM10 concentration measurements alone, and the added values are analyzed. The emission inversion results reveal that wind-blown dust emissions originated from both China and Mongolia during spring 2021. Specifically, 19.9×106 and 37.5×106ĝ€¯t of particles were released in the Chinese and Mongolian Gobi, respectively, during these severe dust events. By source apportionment it was revealed that the Mongolian Gobi poses more severe threats to the densely populated regions of the Fenwei Plain (FWP) and the North China Plain (NCP) located in northern China than does the Chinese Gobi. It was estimated that 63ĝ€¯% of the dust deposited in FWP was due to transnational transport from Mongolia. For NCP, the long-distance transport dust from Mongolia contributes about 69ĝ€¯% to the dust deposition.

In this paper, we propose an efficient and practical implementation of the ensemble Kalman filter via shrinkage covariance matrix estimation. Our filter implementation combines information brought by an ensemble of model realizations, and that based on our prior knowledge about the dynamical system of interest. We perform the combination of both sources of information via optimal shrinkage factors. The method exploits the rank-deficiency of ensemble covariance matrices to provide an efficient and practical implementation of the analysis step in EnKF based formulations. Localization and inflation aspects are discussed, as well. Experimental tests are performed to assess the accuracy of our proposed filter implementation by employing an Advection Diffusion Model and an Atmospheric General Circulation Model. The experimental results reveal that the use of our proposed filter implementation can mitigate the impact of sampling noise, and even more, it can avoid the impact of spurious correlations during assimilation steps.

The use of low air quality networks has been increasing in recent years to study urban pollution dynamics. Here we show the evaluation of the operational Aburrá Valley’s low-cost network against the official monitoring network. The results show that the PM_2.5 low-cost measurements are very close to those observed by the official network. Additionally, the low-cost allows a higher spatial representation of the concentrations across the valley. We integrate low-cost observations with the chemical transport model Long Term Ozone Simulation-European Operational Smog (LOTOS-EUROS) using data assimilation. Two different configurations of the low-cost network were assimilated: using the whole low-cost network (255 sensors), and a high-quality selection using just the sensors with a correlation factor greater than 0.8 with respect to the official network (115 sensors). The official stations were also assimilated to compare the more dense low-cost network’s impact on the model performance. Both simulations assimilating the low-cost model outperform the model without assimilation and assimilating the official network. The capability to issue warnings for pollution events is also improved by assimilating the low-cost network with respect to the other simulations. Finally, the simulation using the high-quality configuration has lower error values than using the complete low-cost network, showing that it is essential to consider the quality and location and not just the total number of sensors. Our results suggest that with the current advance in low-cost sensors, it is possible to improve model performance with low-cost network data assimilation.

Tropospheric ozone is a secondary pollutant which can affect human health and plant growth. In this paper, we investigated transferred convolutional neural network long short-term memory (TL-CNN-LSTM) model to predict ozone concentration. Hourly CNN-LSTM model is used to extract features and predict ozone for next hour, which is superior to commonly used models in previous studies. In the daily ozone prediction model, prediction over a large time-scale requires more data, however, only limited data are available, which causes the CNN-LSTM model to fail to accurately predict. Network-based transfer learning methods based on hourly models can obtain information from smaller temporal resolution. It can reduce prediction errors and shorten run time for model training. However, for extreme cases where the amount of data is severely insufficient, transfer learning based on smaller time scale cannot improve model prediction accuracy.

Air quality warning and forecasting systems are usually based on numerical chemical transport models (CTMs). Those dynamic models perform predictions by simulating the life cycles of the atmospheric components, including emission, transport and removal. However, the accuracy of these CTMs are still limited because of many imperfections, e.g., uncertainties in the input sources such as emission inventories, wind fields, boundary conditions, as well as insufficient knowledge about the atmospheric dynamics themselves. All these will mislead the CTM prediction constantly, or in a systematic way. In this paper, an approach based on machine learning is applied to predict model bias in the CTM. It is then combined with the CTM for formulating a hybrid forecast system. To our knowledge, it is the first time that machine learning methods are used in this way. The hybrid system is tested on the fine particular matter (PM_2.5) prediction in Shanghai, China. The results showed that machine learning can be an effective tool to improve the accuracy of CTM prediction. In case of short term PM_2.5 forecast (forecast length less than 12 h), statistical metrics of the root mean square error, mean absolute error, mean absolute percentage error as well as the air quality rank predicted accuracy all show the forecast skill is remarkably improved; while for long term prediction, improvement is not ensured.

Emission inversion using data assimilation fundamentally relies on having the correct assumptions about the emission background error covariance. A perfect covariance accounts for the uncertainty based on prior knowledge and is able to explain differences between model simulations and observations. In practice, emission uncertainties are constructed empirically; hence, a partially unrepresentative covariance is unavoidable. Concerning its complex parameterization, dust emissions are a typical example where the uncertainty could be induced from many underlying inputs, e.g., information on soil composition and moisture, land cover and erosive wind velocity, and these can hardly be taken into account together. This paper describes how an adjoint model can be used to detect errors in the emission uncertainty assumptions. This adjoint-based sensitivity method could serve as a supplement of a data assimilation inverse modeling system to trace back the error sources in case large observation-minus-simulation residues remain after assimilation based on empirical background covariance.

The method follows an application of a data assimilation emission inversion for an extreme severe dust storm over East Asia <span classCombining double low line"cit"idCombining double low line"xref_paren.1">(<a hrefCombining double low line"#bib1.bibx31">Jin et al.</a>, <a hrefCombining double low line"#bib1.bibx31">2019</a><a hrefCombining double low line"#bib1.bibx31">b</a>)</span>. The assimilation system successfully resolved observation-minus-simulation errors using satellite AOD observations in most of the dust-affected regions. However, a large underestimation of dust in Northeast China remained despite the fact that the assimilated measurements indicated severe dust plumes there. An adjoint implementation of our dust simulation model is then used to detect the most likely source region for these unresolved dust loads. The backward modeling points to the Horqin desert as the source region, which was indicated as a non-source region by the existing emission scheme. The reference emission and uncertainty are then reconstructed over the Horqin desert by assuming higher surface erodibility. After the emission reconstruction, the emission inversion is performed again, and the posterior dust simulations and reality are now in much closer harmony. Based on our results, it is advised that emission sources in dust transport models include the Horqin desert as a more active source region.

Aerosol optical depths (AODs) from the new Himawari-8 satellite instrument have been assimilated in a dust simulation model over East Asia. This advanced geostationary instrument is capable of monitoring the East Asian dust storms which usually have great spatial and temporal variability. The quality of the data has been verified through a comparison with AErosol RObotic NETwork AODs. This study focuses on extreme dust events only when dust aerosols are dominant; promising results are obtained in AOD assimilation experiments during a case in May 2017. The dust emission fields that drive the simulation model are strongly improved by the inverse modeling, and consequently, the simulated dust concentrations are in better agreements with the observed AOD as well as ground-based observations of PM ₁₀ . However, some satellite AODs show significant inconsistence with the simulations and the PM ₁₀ and AErosol RObotic NETwork observations, which might arise from retrieval errors over a partially clouded scene. The data assimilation procedure therefore includes a screening method to exclude these observations in order to avoid unrealistic results. A dust mask screening method is designed, which is based on selecting only those observations where the deterministic model produces a substantial amount of dust. This screen algorithm is tested to give more accurate result compared to the traditional method based on background covariance in the case study. Note that our screen method would exclude valuable information in case the model is not able to simulate the dust plume shape correctly; hence, applications in related studies require inspections of simulations and observations by user.

In previous studies, a number of model-based dust forecasts and early warning systems have been developed for the prevention of environmental impacts due to dusts. However, the accuracy of the model is limited by imperfect identification of dust emissions, in particular by the friction velocity threshold parameterization in the emission process. In this study, an integrated dust storm forecast system - LOTOS-EUROS/Dust coupled with reduced-tangent-linearization 4DVar data assimilation has been developed. In order to overcome the inflexibility and inaccuracy of the existing friction velocity threshold parameterization in large-scale models, a spatially varying multiplicative factor for the threshold is introduced. This parameter is estimated by assimilating measurements from a field station network developed by China Ministry of Environmental Protection. The data assimilation algorithm is adjoint-free, and its computational complexity increases with the number of uncertain parameters. Two model reducing techniques, sensitivity-based parameter filters and proper orthogonal decomposition, are sequentially implemented after each other, which lead to a reduction of parameter dimension from initially O(10⁴) to O(10²). Twin experiments are conducted to evaluate the impact of assimilation settings on the dust forecast accuracy. In addition, experiments with real observations are conducted. However, these observations also reflect the aerosol concentration from local emissions. To effectively use these observations as representative for dust concentrations, an observation bias correction and a variable representation error are designed. Improvements on the dust storm forecast with our system are demonstrated.