In this work,a gradient method with momentum for BP neural networks is considered.The momentum coefficient is chosen in an adaptive manner to accelerate and stabilize the learning procedure of the network weights.Corresponding convergence results are proved.