In this report we developed two main parts. In the first part we studied the different styles of training: sequential and batch. We distinguished between the two architectures of the neural networks: stationary and dynamic. In the second part we chose the dynamic architecture with a sequential training in order to implement an on-line training algorithm for the beta basis functions neural networks named ACE-FBB and a version improved of this last, named ACER-FBB..