A fast, streaming SIMD extensions 2, logistic squashing function
Milner, J.J. and Grandison, A.J. (2008) A fast, streaming SIMD extensions 2, logistic squashing function. Neural Computation, 20 (12). pp. 2967-2972. ISSN 0899-7667 (Print), 1530-888X (Online) (doi:10.1162/neco.2008.10-06-366)Full text not available from this repository.
Schraudolph proposed an excellent exponential approximation providing increased performance particularly suited to the logistic squashing function used within many neural networking applications. This note applies Intel's streaming SIMD Extensions 2 (SSE2), where SIMD is single instruction multiple data, of the Pentum IV class processor to Schraudolph's technique, further increasing the performance of the logistic squashing function. It was found that the calculation of the new 32-bit SSE2 logistic squashing function described here was up to 38 times faster than the conventional exponential function and up to 16 times faster than a Schraudolph-style 32-bit method on an Intel Pentum D 3.6 GHz CPU.
Actions (login required)