• NUCLEAR TECHNIQUES
  • Vol. 46, Issue 2, 020401 (2023)
Shuliang MA1、2, Huajun LIU2、*, Fang LIU2, Shuqing ZHANG2、3, Tong LI2, Yi SHI2, and Liang GUO2
Author Affiliations
  • 1Institute of Physical Science and Information Technology, Anhui University, Hefei 230601, China
  • 2Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
  • 3University of Science and Technology of China, Hefei 230026, China
  • show less
    DOI: 10.11889/j.0253-3219.2023.hjs.46.020401 Cite this Article
    Shuliang MA, Huajun LIU, Fang LIU, Shuqing ZHANG, Tong LI, Yi SHI, Liang GUO. CRAFT magnet performance research platform data archiving system[J]. NUCLEAR TECHNIQUES, 2023, 46(2): 020401 Copy Citation Text show less

    Abstract

    Background

    The comprehensive research facility for fusion technology magnet performance research platform (MPRP) is a large-scale experimental platform established for advanced superconducting magnet experiments. The retrieval speed of MPRP historical data is slow due to massive storage.

    Purpose

    The study aims to develop a MPRP data archiving system (MPDAS) and increase its retrieval speed.

    Methods

    First of all, the experimental physics and industrial control system (EPICS) data archiving plug-in was designed for MPDAS. Both MongoDB Sharding and Replica Set mechanism were employed to build a highly scalable data storage architecture. Then, the core ideas of three traditional cache replacement algorithms, LRU (least recently used), LFU (least frequently used) and FIFO (first in first out) were drawn by MPDAS to establish a data temperature model based on Newton's law of cooling. A multi-dimensional feature data partitioning algorithm was implemented to integrate access time, access frequency and storage order, hence the hot and cold historical data were identified to realize data tiered storage. Finally, the retrieval speed of MPDAS was improved by preferentially accessing Redis when querying historical data, and selecting different retrieval strategies based on hit results and data integrity.

    Results

    The system test results show that the functional characteristics of MPDAS meet the design requirements. Compared with FIFO, LRU, and LFU, the Redis hit rate of the MPDAS when the hot database stores 1% of the historical data is increased by 38.05%, 26.91%, and 11.06% respectively.

    Conclusions

    By increasing the hit rate of hot data, the average response time of data retrieval can be directly reduced. The retrieval response speed of MPDAS is effectively improved by quantifying the heat of historical data and dividing the heat and cold.

    Shuliang MA, Huajun LIU, Fang LIU, Shuqing ZHANG, Tong LI, Yi SHI, Liang GUO. CRAFT magnet performance research platform data archiving system[J]. NUCLEAR TECHNIQUES, 2023, 46(2): 020401
    Download Citation