proposed a method for parallelization of neural network training based on the backpropagation algorithm and implemented it using two different multithreading techniques (OpenMP and POSIX threads
) applicable to the current and next generation of multithreaded and multi-core CPUs.
Parallelization can be easily implemented on multicore central processing unit (CPU) with existing application program interfaces (APIs) such as POSIX threads
and OpenMP .
Intended for intermediate developers, this book introduces the GNU tools needed to build, segment, test, profile, and distribute Linux applications, and describes some of the most useful services available within the GNU/Linux environment, such as pipes, sockets programming, POSIX threads
, message queues, semaphores, and shared memory management.
PGDBG adds support for automatic process attach to running processes in 32-bit or 64-bit OpenMP, MPI, or hybrid OpenMP/MPI programs, dynamically-linked threads libraries, support for the new Native Posix Threads
Library (NPTL) for Linux, and support for either MPI-CH or LAM MPI.
A library implementation of POSIX threads
Although OpenMP is designed primarily to take advantage of processors within a shared memory system - MPI message passing and Posix threads
are used to connect clustered or distributed systems - a group of academics are currently experimenting with layering OpenMP on top of clustering software protocols to link distributed systems, in a project known as Odin.