A fast, streaming SIMD extensions 2, logistic squashing function

Milner, J.J. and Grandison, Angus (2008) A fast, streaming SIMD extensions 2, logistic squashing function. Neural Computation, 20 (12). pp. 2967-2972. ISSN 0899-7667 (Print), 1530-888X (Online)

Abstract

Schraudolph proposed an excellent exponential approximation providing increased performance particularly suited to the logistic squashing function used within many neural networking applications. This note applies Intel's streaming SIMD Extensions 2 (SSE2), where SIMD is single instruction multiple data, of the Pentum IV class processor to Schraudolph's technique, further increasing the performance of the logistic squashing function. It was found that the calculation of the new 32-bit SSE2 logistic squashing function described here was up to 38 times faster than the conventional exponential function and up to 16 times faster than a Schraudolph-style 32-bit method on an Intel Pentum D 3.6 GHz CPU.

Actions (login required)