Log integration on large scale for global networking monitoring

Log integration on large scale for global networking monitoring

时间:2012-07-25 航空航天论文
Abstract:Supposing that the overall situation is dug out from the distributed monitoring nodes, there should be two critical obstacles, heterogenous schema and instance, to integrating heterogeneous data from different monitoring sensors. To tackle the challenge of heterogenous schema, an instance-based approach for schema mapping, named instance-based machine-learning (IML) approach was described. And to solve the problem of heterogenous instance, a novel approach, called statistic-based clustering (SBC) approach, which utilized clustering and statistics technologies to match large scale sources holistically, was also proposed. These two algorithms utilized the machine-leaning and clustering technology to improve the accuracy. Experimental analysis shows that the IML approach is more precise than SBC approach, reaching at least precision of 81% and recall rate of 82%. Simulation studies further show that SBC can tackle large scale sources holistically with 85% recall rate when there are 38 data sources. 作者: Author: MIAO Jia-jia[1]  WU Quan-yuan[2]  JIA Yan[2] 作者单位: School of Computer, National University of Defense Technology, Changsha 410073, China;Institute of Command Automation, PLA University of Science and Technology, Nanjing 210007, ChinaSchool of Computer, National University of Defense Technology, Changsha 410073, China 期 刊: 中南大学学报(英文版)   EISCI Journal: JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY(ENGLISH EDITION) 年,卷(期): 2009, 16(6) 分类号: V2 Keywords: machine-learning    clustering    data integration    schema matching    instance matching    机标分类号: TG1 TP3 机标关键词: novel approach    distributed monitoring    Experimental analysis    schema mapping    technology    algorithms    situation    different    challenge    data    studies    improve    two 基金项目: the National High-Tech Research and Development Program of China,the Program for New Century Excellent Talents in University Log integration on large scale for global networking monitoring[期刊论文]  中南大学学报(英文版) --2009, 16(6)Supposing that the overall situation is dug out from the distributed monitoring nodes, there should be two critical obstacles, heterogenous schema and instance, to integrating heterogeneous data from d...