The adaptive research of data layout in large-scale meteorological data storage system
In the existing large-scale meteorological data storage systems, the real-time of meteorological data applications is poor; transmission of data process is opaque; meteorological data sharing is complex and self-adaptability is bad; the capability of data quality assurance is not good. For these problems, this paper presents a solution of large-scale meteorological data storage system. This paper also presents a consistent hierarchical Hash data layout algorithm. It used to solve transmission and re-layout problem in the system among meteorological data, storage devices, content transmission network and key data buffer devices. And we test this algorithm's fairness, efficiency and adaptability by experiment.