
- High Power Laser Science and Engineering
- Vol. 12, Issue 4, 04000e46 (2024)
Abstract
Keywords
1 Introduction
The dynamic mechanical properties of materials are strongly dependent on the temporal evolution of material structures at the micro mesoscale, and have important applications in extreme scenarios such as celestial evolution and inertial confinement fusion[1–3]. The average grain size and grain distribution are the key microstructure characteristics that affect the physical and chemical properties[4–6], representing the fundamental qualities of polycrystalline materials, and therefore are of vital importance in predicting material responses, evaluating the kinetic phase transformation process and gaining insight into the physical properties.
As a microstructure characterization technology, small-angle X-ray scattering (SAXS) is of significant value in high-pressure material science[7–10] and high-power laser experiments[11,12]. In a typical scattering experiment, the X-ray impacts the sample at a small angle and is scattered. The intensity of the scattered wave is measured and recorded by the detector and presented as a scattering pattern. For example, in the dynamic compression experiment of polymer dissociation, nanocrystalline solid particles can be formed and then consolidated into larger particles[13,14]. In the process of nucleation and subsequent phase transformation in such materials[15], the average particle size, grain size distribution, particle shape, spacing, particle content and other microstructure characteristics will all affect the morphology and intensity of the scattering spectrum.
The inversion of nanoparticles due to phase transition in extreme conditions is a major challenge. Extracting particle size distribution from the scattering pattern is a typical ill-posed problem. Algorithms such as maximum entropy, renormalization, regularization, the non-negative least squares method and other methods have been widely used to extract the particle size distribution from the scattering data and extensively implemented in software such as Irena, IsGISAXS and McSAS[16–20]. These algorithms are mainly searching for optimization parameters that satisfy the condition of
Sign up for High Power Laser Science and Engineering TOC. Get the latest issue of High Power Laser Science and Engineering delivered right to you!Sign up now
With the emergence of fourth generation X-ray free electron lasers, it is possible to quickly image and obtain in situ response of materials, for example, in dynamic shock-compression environments[22]. Large quantities of data, with laser shock drivers reaching repetition rates of up to 10 Hz[23], also pose a demand for rapid inversion of SAXS. In recent years, with the continuous advent of machine learning, it is possible to quickly retrieve scattering images and conduct on-site analysis. In view of the strong mapping ability of artificial neural networks (ANNs), it can be well applied to in situ classification and quantification of scattering images, including grazing-incidence small-angle scattering (GISAS)[24], coherent diffraction imaging (CDI)[25], microstructural characterization in 3D samples[6], etc. The ability of ANNs to quickly and accurately identify the main characteristics is very important for the rapid characterization of crystal grain distribution, thus having a practical significance for the research in microstructure and phase transformation of dynamically compressed materials.
In this work, we apply a fully connected, dense, feedforward network according to the principle of SAXS to extract the mean grain size and grain size distribution of nanocrystals from in situ SAXS images in experiments, allowing automatic acquisition of microstructure information and avoiding the traditional tedious manual fitting process. Using the trained network, the particle distributions obtained from simulation data are verified to be in good agreement with the theory. Taking a typical nanoparticle transformation experiment as an example[22], we use the network to retrieve the average grain size as well as the grain distribution, and compare it with other methods to ensure that the neural network prediction is meaningful and applicable for SAXS. This network is also suitable for the case of spherical voids in porous materials. The beneficial modifications based on our network are applicable to the arbitrary size inversion of other shapes with density contrast from SAXS, which is of great value for the on-site characterization of materials under dynamic compression.
2 Training the neural network
According to the principle of SAXS, we can establish a fully connected feedforward network that corresponds exactly to our physical phenomena. The dataset with various particle distributions as well as their volume fractions (representing particle concentration) is used as the labels of the network, while the corresponding scattering intensities are used as the input dataset. For the predicted particle distributions from the neural network, the loss function of the training and validation data can be calculated and the network parameters are adjusted to minimize the loss. The process can then be repeated for several epochs until an acceptable loss value is reached.
2.1 Data generation
The dataset for the neural network is generated on the basis of the classical SAXS theory. The expected scattering intensity
We created a dataset of scattering intensity generated by hard-spheres with an effective particle size range of 1–9 nm and a volume fraction range of 0.1–0.5, which corresponds exactly to our physical conditions[13,15,22]. For example, we estimated the size of the generated nanoparticles from shock-compressed polymer samples via other diagnostics (such as X-ray diffraction) to be several nanometers, with a volume fraction between 10% and 50%. Considering the possible distribution range of actual grain size in these experiments, we chose particle size distribution between 0.9 and 9.9 nm as the target labels, represented by 100 equally discrete probability values. When creating a random particle size distribution, we selected the composition of three Shulz distributions with random effective radii as the total probability for different particle sizes. To assess the robustness of the network, we artificially added 0–3% noise to the theoretical SAXS intensity data. This is based on the fact that the error of SAXS lineouts obtained on a high-energy X-ray light source is mainly related to the instrument and light source quality, which causes an intensity error of less than 2%[22]. ANNs can generalize well to any particle size distribution by training on this simple data. In addition, the
Figure 1.Schematic of the training process.
Parameter | Min value | Max value | Unit |
---|---|---|---|
0.4 | 1.05 | ||
Effective radius | 1.0 | 9.0 | nm |
Particle distribution | 0.9 | 9.9 | nm |
Volume fraction | 10.0 | 50.0 | % |
Table 1. Parameter ranges during data generation.
In order to prevent the slow convergence of features during optimization[31], it is necessary to preprocess and normalize the data, which is an important step of neural network training. The entire dataset was scaled after creating the training-validation databases so that all the input and target features were in the range [0, 1] according to the following:
2.2 Compilation and training of the ANN
The compilation of the neural network and the training were performed using the Keras package running the TensorFlow backend[32].
We established a fully connected dense feedforward network according to our physical case with a rectified linear unit (ReLU)[33] as the nonlinear activation function. The input layer includes 1000 discrete intensity values as well as one volume fraction value, while the output layer contains 100 discrete probability values representing size distribution. The middle three hidden layers have 128, 64 and 32 neurons, respectively. We chose the mean absolute error (MAE) as the loss function in the training and testing process (see Equation (5)). The backpropagation[34] and the stochastic gradient descent optimization algorithm[35] were used to adjust the weights and biases iteratively until the loss function was minimized. In each iteration process, the network calculated the gradient of the batch loss relative to the weight and then updated the weight accordingly:
The ANN was trained along with adjusting the memorization capacity (the number of hidden layers or neurons) to find the optimal network structure, avoiding an underfit and overfit. In each training process, 4680 datasets with more than 4 million trainable parameters were trained.
Figure 2 shows the training and validation loss or accuracy as a function of epoch. The validation loss is very close to the training loss, indicating that although the model is complex, it does not overfit the training data, and has good generalization ability in the verification dataset.
Figure 2.Training and validation loss as well as accuracy of the neural network which contains three middle hidden layers with 128, 64 and 32 neurons, respectively.
3 Evaluation of the trained network
Based on the trained neural network, the grain distribution can be quickly and reliably retrieved from scattering data. Therefore, the property of the trained network should be evaluated by measuring its performance in a large number of theoretical data.
3.1 Applying the ANN to the theoretical models
Figure 3 depicts the predictions of the trained ANN on several theoretical data. After inputting the theoretical SAXS intensity lineout data with 0–3% noise to the trained ANN, the network can directly give the particle distribution, as shown in the blue histogram in the right-hand column of Figure 3. Aiming at arbitrary particle distribution with various patterns, our predicted particle distribution and the effective radius are in good agreement with the theoretical ones. Conversely, the corresponding SAXS lineout can also be calculated from the predicted distribution, as shown in the left-hand column of Figure 3, which is almost consistent with the original theoretical SAXS lineout in the majority of cases, implying a high reliability in the prediction of arbitrary particle distributions from theoretical data with noise.
Figure 3.Applying the ANN to the theoretical models. Seven arbitrary particle distributions predicted by the ANN (right-hand panel) and their corresponding fitting curves (left-hand panel) compared with the initial theoretical models.
However, for simple distributions with small particle radii, the difficulty of fitting increases due to the tiny variation of scattering intensity in the range of
3.2 Applying the ANN to the experiments
In order to evaluate the performance of the ANN on the experimental data, we assess the ANN with the real-time in situ SAXS experimental data measured in dynamic experiments. Five SAXS intensity data of shock-compressed
Figure 4.The nanoparticle distributions generated from shock-compressed PET obtained by the ANN, Monte Carlo method and analytical model (left-hand panel) and their corresponding SAXS fitting curves compared with the experimental data (right-hand panel). The red dots indicate the resulting mean particle radius from the three methods. The color bar represents the various probing times.
Other aspects of actual experiments, such as the bandwidth and the high harmonics of the probe light spectrum, can also affect the size distribution inversion from SAXS[39]. For the shock-compression phase transition described above, the accuracy of the experiment is not that high and the influence of the spectral bandwidth and high harmonics can be ignored. Of course, in some more precise SAXS inversion problems, the influence of the spectrum cannot be ignored. In these cases, the ANN can be constructed through the following methods: directly input the scattering spectrum and particle size distribution obtained from the specified spectrum into the ANN for training, or add parameters representing the spectral features to the ANN for training.
4 Conclusions
To conclude, in view of the request for rapid analysis of generous SAXS data at large-scale laser facilities, in this work, we apply a dense forward network to inversely retrieve the mean grain size and particle distribution from SAXS data, allowing automatic acquisition of microstructure information without tedious manual fitting in traditional methods. Our trained network performs well in grain distribution prediction on experimental data with single-species particles. The predicted results have good consistency with the Monte Carlo method, which also inversely retrieve the arbitrary distribution and is more efficient.
Since the scattering intensity comes from density contrast, theoretically, our trained network can also be applied to the case of void distribution with spherical shapes in porous materials, but its effectiveness still needs further experimental verification. In further work, two possible improvements can be considered if this network is to be applied to non-spherical particles or voids. One is that the network needs to be retrained for particles or voids of specific shapes, and the method of constructing and training the network can be consistent with this work. A more universal approach is to add additional factors representing the shape of particles to the input of the network on the basis of this method, and then retrain the network. In short, the powerful advantages of the ANN can be utilized in the study of dynamic physical processes by adding scattering shape parameters, optimizing model structures, etc. In addition, improvements in the diagnosis of the experiment, such as increasing the scattering angle range and improving the signal-to-noise ratio, can also enhance the accuracy of the results obtained from the ANN model.
References
[1] C.-S. Yoo. Matter Radiat. Extremes, 5, 018202(2020).
[2] D. H. Kalantar, J. F. Belak, G. W. Collins, J. D. Colvin, H. M. Davies, J. H. Eggert, T. C. Germann, J. Hawreliak, B. L. Holian, K. Kadau, P. S. Lomdahl, H. E. Lorenzana, M. A. Meyers, K. Rosolankova, M. S. Schneider, J. Sheppard, J. S. Stolken, J. S. Wark. Phys. Rev. Lett., 95, 075502(2005).
[3] R. Betti, O. A. Hurricane. Nat. Phys., 12, 435(2016).
[4] S. E. Offerman, N. H. van Dijk, J. Sietsma, S. Grigull, E. M. Lauridsen, L. Margulies, H. F. Poulsen, M. T. Rekveldt, S. van der Zwaag. Science, 298, 1003(2002).
[5] E. Arzt. Acta Mater., 46, 5611(1998).
[6] H. Chan, M. Cherukara, T. D. Loeffler, B. Narayanan, S. Sankaranarayanan. npj Comput. Mater., 6, 1(2020).
[7] M. Bagge-Hansen, S. Bastea, J. A. Hammons, M. H. Nielsen, L. M. Lauderbach, R. L. Hodgin, P. Pagoria, C. May, S. Aloni, A. Jones, W. L. Shaw, E. V. Bukovsky, N. Sinclair, R. L. Gustavsen, E. B. Watkins, B. J. Jensen, D. M. Dattelbaum, M. A. Firestone, R. C. Huber, B. C. Ringstrand, J. R. I. Lee, T. van Buuren, L. E. Fried, T. M. Willey. Nat. Commun., 10, 3819(2019).
[8] S. Humbert, O. Lame, J. M. Chenal, C. Rochas, G. Vigier. Macromolecules, 43, 7212(2010).
[9] M. Bech, S. Schleede, G. Potdevin, K. Achterhold, O. Bunk, T. H. Jensen, R. Loewen, R. Ruth, F. Pfeiffer. Photonics Lasers Med., 1, 47(2012).
[10] Y. W. Shi, Y. Y. Zhang, S. Chen, S.-N. Luo. Mater. Today Commun., 34, 105095(2023).
[11] T. Kluge, M. Rödel, J. Metzkes-Ng, A. Pelka, A. L. Garcia, I. Prencipe, M. Rehwald, M. Nakatsutsumi, E. E. McBride, T. Schönherr, M. Garten, N. J. Hartley, M. Zacharias, J. Grenzer, A. Erbe, Y. M. Georgiev, E. Galtier, I. Nam, H. J. Lee, S. Glenzer, M. Bussmann, C. Gutt, K. Zeil, C. Rödel, U. Hübner, U. Schramm, T. E. Cowan. Phys. Rev. X, 8, 031068(2018).
[12] Y. J. Deng, Y. Y. Zhang, Z. Cao, S. Chen, S. N. Luo. AIP Adv., 12, 025301(2022).
[13] D. Kraus, J. Vorberger, A. Pak, N. J. Hartley, L. B. Fletcher, S. Frydrych, E. Galtier, E. J. Gamboa, D. O. Gericke, S. H. Glenzer, E. Granados, M. J. MacDonald, A. J. MacKinnon, E. E McBride, I. Nam, P. Neumayer, M. Roth, A. M. Saunders, A. K. Schuster, P. Sun, T. van Driel, T. Dppner, R. W. Falcone. Nat. Astronomy, 1(2017).
[14] D. Kraus, N. J. Hartley, S. Frydrych, A. K. Schuster, K. Rohatsch, M. Rödel, T. E. Cowan, S. Brown, E. Cunningham, T. Van Driel, L. B. Fletcher, E. Galtier, E. J. Gamboa, A. Laso Garcia, D. O. Gericke, E. Granados, P. A. Heimann, H. J. Lee, M. J. MacDonald, A. J. MacKinnon, E. E. McBride, I. Nam, P. Neumayer, A. Pak, A. Pelka, I. Prencipe, A. Ravasio, R. Redmer, A. M. Saunders, M. Schölmerich, M. Schörner, P. Sun, S. J. Turner, A. Zettl, R. W. Falcone, S. H. Glenzer, T. Döppner, J. Vorberger. Phys. Plasmas, 25, 056313(2018).
[15] A. K. Schuster, N. J. Hartley, J. Vorberger, T. Döppner, T. van Driel, R. W. Falcone, L. B. Fletcher, S. Frydrych, E. Galtier, E. J. Gamboa, D. O. Gericke, S. H. Glenzer, E. Granados, M. J. MacDonald, A. J. MacKinnon, E. E. McBride, I. Nam, P. Neumayer, A. Pak, I. Prencipe, K. Voigt, A. M. Saunders, P. Sun, D. Kraus. Phys. Rev. B, 101, 054301(2020).
[16] P. R. Jemian, J. R. Weertman, G. G. Long, R. D. Spal. Acta Metall. Mater., 39, 2477(1991).
[17] J. Ilavsky, P. R. Jemian. J. Appl. Crystallogr., 42, 347(2009).
[18] R. Lazzari. J. Appl. Crystallogr., 35, 406(2002).
[19] B. R. Pauw, J. S. Pedersen, S. Tardif, M. Takata, B. B. Iversen. J. Appl. Crystallogr., 46, 365(2013).
[20] I. Breßler, B. R. Pauw, A. F. Thünemann. J. Appl. Crystallogr., 48, 962(2015).
[21] L. Gaus, L. Bischoff, M. Bussmann, E. Cunningham, C. B. Curry, E. Juncheng, E. Galtier, M. Gauthier, A. L. García, M. Garten, S. Glenzer, E. Juncheng, J. Grenzer, C. Gutt, N. J. Hartley, E. E. McBride, J. Metzkes-Ng, L. Huang, U. Hübner, D. Kraus, B. Nagler, M. Nakatsutsumi, A. Pelka, I. Prencipe, J. Nikl, H. J. Lee, M. Ota, L. Randolph, M. Rödel, Y. Sakawa, H.-P. Schlenvoigt, M. Šmíd, F. Treffert, K. Voigt, U. Schramm, K. Zeil, T. Kluge, T. E. Cowan. Phys. Rev. Res., 3, 043194(2021).
[22] Z. He, M. Rödel, J. Lütgert, A. Bergermann, M. Bethkenhagen, D. Chekrygina, T. E. Cowan, A. Descamps, M. French, E. Galtier, A. E. Gleason, G. D. Glenn, S. H. Glenzer, Y. Inubushi, N. J. Hartley, J.-A. Hernandez, B. Heuser, O. S. Humphries, N. Kamimura, K. Katagiri, D. Khaghani, H. J. Lee, E. E. McBride, K. Miyanishi, B. Nagler, B. Ofori-Okai, N. Ozaki, S. Pandolfi, C. Qu, D. Ranjan, R. Redmer, C. Schoenwaelder, A. K. Schuster, M. G. Stevenson, K. Sueda, T. Togashi, T. Vinci, K. Voigt, J. Vorberger, M. Yabashi, T. Yabuuchi, L. M. V. Zinta, A. Ravasio, D. Kraus. Sci. Adv., 8, eabo0617(2022).
[23] U. Zastrau, M. McMahon, K. Appel, C. Baehtz, E. Brambrink, R. Briggs, T. Butcher, B. Cauble, B. Chen, H. Damker, C. Deiter, J. Eggert, K. Falk, L. Fletcher, S. H. Glenzer, S. Göde, M. Harmand, A. Higginbotham, Z. Konôpková, D. Kraus, H.-P. Liermann, M. Nakatsutsumi, A. Pelka, G. Priebe, R. Redmer, A. Schropp, R. Smith, P. Sperling, I. Thorpe, S. Toleikis. , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and , “Conceptual design report: Dynamic laser compression experiments at the hed instrument of european XFEL,” Technical Report XFEL.EU TR-2017-001, Dynamic Laser Compression at HED, Schenefeld, European X-Ray Free-Electron Laser Facility GmbH, Germany ().(2017).
[24] W. Van Herck, J. Fisher, M. Ganeva. Mater. Res. Express, 8, 045015(2021).
[25] M. J. Cherukara, Y. S. G. Nashed, R. J. Harder. Sci. Rep., 8, 16520(2018).
[26] M. Rödel. , “Coherent X-ray Diffraction of Laser-driven Matter.” PhD thesis, Technische Universität Dresden ().(2021).
[27] M. S. Wertheim. Phys. Rev. Lett., 10, 321(1963).
[28] J. K. Percus, G. J. Yevick. Phys. Rev., 110, 1(1958).
[29] D. J. Kinning, E. L. Thomas. Macromolecules, 17, 1712(1984).
[30] J. S. Pedersen. J. Appl. Crystallogr., 27, 595(1994).
[31] Y. Lecun, L. Bottou, G. B. Orr, K. R. MullerNeural Networks: Tricks of the Trade. , , , and , in (Springer, ).(1998).
[32] F. Chollet. Keras: The Python Deep Learning Library(2018).
[33] A. F. Agarap. , ().(2018). arXiv:1803.08375
[34] D. E. Rumelhart, G. E. Hinton, R. J. Williams. Nature, 323, 533(1986).
[35] L. Bottou. Neural Networks: Tricks of the Trade(2012).
[36] J. Lütgert, J. Vorberger, N. J. Hartley, K. Voigt, M. Rödel, A. K. Schuster, A. Benuzzi-Mounaix, S. Brown, T. E. Cowan, E. Cunningham, T. Döppner, R. W. Falcone, L. B. Fletcher, E. Galtier, S. H. Glenzer, A. L. Garcia, D. O. Gericke, P. A. Heimann, H. J. Lee, E. E. McBride, A. Pelka, I. Prencipe, A. M. Saunders, M. Schölmerich, M. Schörner, P. Sun, T. Vinci, A. Ravasio, D. Kraus. Sci. Rep., 11, 12883(2021).
[37] M. Kotlarchyk, S.-H. Chen. J. Chem. Phys., 79, 2461(1983).
[38] J. Als-Nielsen, D. McMorrow. Elements of Modern X-ray Physics(2011).
[39] S. Chen, S.-N. Luo. J. Synchrotron Radiat., 25, 496(2018).

Set citation alerts for the article
Please enter your email address