神经网络算法

1000-9825/2003/14(02)0194 ©2003 Journal of Software 软 件 学 报 Vol.14, No.2 构造型神经网络双交叉覆盖增量学习算法

陶 品+, 张 钹, 叶 榛

(清华大学 计算机科学与技术系,北京 100084)

(清华大学 智能技术与系统国家重点实验室,北京 100084)

An Incremental BiCovering Learning Algorithm for Constructive Neural Network TAO Pin+, ZHANG Bo, YE Zhen

(Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China)

(State Key Laboratory of Intelligent Technology and System, Tsinghua University, Beijing 100084, China)

+ Corresponding author: Phn: 86-10-62775113, E-mail: taopin97@mails.tsinghua.edu.cn

www.wendangwang.com

Received 2002-03-28; Accepted 2002-05-17

Tao P, Zhang B, Ye Z. An incremental bicovering learning algorithm for constructive neural network. Journal of Software, 2003,14(2):194~201.

Abstract: The algorithm of incremental learning in cover based constructive neural networks (CBCNN) is investigated by using BiCovering algorithm (BiCA) in this paper. This incremental learning algorithm based on the idea of CBCNN can set up many postive-covers and negative-covers, and can modify and optimize the parameters and structure of the neural networks continuously, and can add the nodes according to the need and prune the redundant nodes. BiCA algorithm not only keep the advantages of CBCNN but also fit for incremental learning and could enhance the generalization capability of the neural networks. The simulational results show that the BiCA algorithm is not sensitive to the order of the sample and could learn quickly and steady even if the performance of initial CBCNN is not very good.

Key words: pattern recognition; neural network; machine learning; cover; incremental learning

摘 要: 研究了基于覆盖的构造型神经网络(cover based constructive neural networks,简称CBCNN)中的双交叉覆盖增量学习算法(BiCovering algorithm,简称BiCA).根据CBCNN的基本思想,该算法进一步通过构造多个正反覆盖簇,使得网络在首次构造完成后还可以不断地修改与优化神经网络的参数与结构,增加或删除网络中的节点,进行增量学习.通过分析认为,BiCA学习算法不但保留了CBCNN网络的优点与特点,而且实现了增量学习并提高了CBCNN网络的泛化能力.仿真实验结果显示,该增量学习算法在神经网络初始分类能力较差的情况下具有快速学习能力,并且对样本的学习顺序不敏感.

关键词: 模式识别;神经网络;机器学习;覆盖;增量学习

中图法分类号: TP181 文献标识码: A

Supported by the National Natural Science Foundation of China under Grant No.60135010 (国家自然科学基金); the National Grand Fundamental Research 973 Program of China under Grant No.G1998030509 (国家重点基础研究发展规划(973))

第一作者简介: 陶品(1974－),男,安徽芜湖人,博士生,主要研究领域为人工神经网络,机器学习.