Parallel levenberg-marquardt-based neural network with variable decay rate

Baček, Tomislav and Majetić, Dubravko and Brezak, Danko (2013) Parallel levenberg-marquardt-based neural network with variable decay rate. = Parallel levenberg-marquardt-based neural network with variable decay rate. In: 14th International Scientific Conference on Production Engineering, 19-22.06.2013, Biograd, Hrvatska.

640499.59-Bacek-Majetic-Brezak-CIM2013-OK.pdf - Accepted Version Jezik dokumenta:English

Download (433kB) | Preview
Official URL:


In this paper, parallel Levenberg-Marquardt-based feed-forward neural network with variable weight decay, implemented on the Graphics Proce-ssing Unit, is suggested. Two levels of parallelism are implemented in the algorithm. One level of parallelism is achieved across the data set, due to inherently parallel structure of the feed-forward neural networks. Another level of parallelism is achieved in Jacobian computation. To avoid third level of parallelism, i.e. parallelization of optimi-zation search steps, and to keep the algorithm simple, variable decay rate is used. Parameters of variable decay rate rule allow for compromise between oscillations and higher accuracy on one side and stable but slower convergence on the other side. To improve training speed and efficiency modification of random weight initializa-tion is included. Testing of a parallel algorithm is performed on two real domain benchmark problems. Results, given in a form of a table with obtained speedups, show the effectiveness of proposed algorithm implementation.

Item Type: Conference or Workshop Item (Lecture)
Keywords (Croatian): neural networks, regression, parallel levenberg-marquardt algorithm
Subjects: TECHNICAL SCIENCE > Mechanical Engineering
Divisions: 900 Department of Robotics and Production System Automation > 910 Chair of Engineering Automation
Indexed in Web of Science: No
Indexed in Current Contents: No
Date Deposited: 27 Oct 2015 07:37
Last Modified: 05 Nov 2018 14:01

Actions (login required)

View Item View Item


Downloads per month over past year

Nema podataka za dohvacanje citata