Automation of Electric Power SystemsVol. 39, Issue 18, Pages: 75-80(2015)
作者机构:
昆明理工大学计算中心,云南省,昆明市,650500
作者简介:
基金信息:
DOI:
CLC:
Published:2015
稿件说明:
移动端阅览
CHEN Yongyan. [J]. Automation of electric power systems, 2015, 39(18): 75-80.
DOI:
CHEN Yongyan. [J]. Automation of electric power systems, 2015, 39(18): 75-80.DOI:
基于Lustre文件系统的海量暂存COMTRADE数据分布存储模式
摘要
研究了一种基于Lustre分布式并行文件系统的高性能I/O流式数据存储模式
能够满足当前行波暂态采集装置海量暂态数据的高速并发读写访问的需求。通过采用多客户端工作模式
并且将多个暂态数据文件聚合成大文件
可以进一步提高访问带宽和使用效率。实验数据表明该模式具有较高的I/O性能
能够满足目前和未来海量电力数据的高速存储管理需求。
Abstract
Massive COMTRADE data storage system should have high I/O performance and good scalability to meet current and future data management needs in an era of big data. This paper is concerned with a high I/O performance stream storage mode based on a Lustre distributed file system. The mode is able to meet the demand for I/O and concurrent access applied in collecting and online analyzing massive COMTRADE data by the gathering device. A multi-clients mode on Lustre and a method of packing multiple COMTRADE files into one big file are adopted to significantly improve I/O scalability. Experimental results show that the mode with its high I/O performance is up to requirement. This work is supported by National Natural Science Foundation of China (No. 51267009).