jax.nn.silu

Warning

This page was created from a pull request (#9655).

jax.nn.silu¶

jax.nn.silu(x)[source]¶

SiLU activation function.

Computes the element-wise function:

\[\mathrm{silu}(x) = x \cdot \mathrm{sigmoid}(x) = \frac{x}{1 + e^{-x}}\]

Parameters: x (Any) – input array
Return type: Any

previous

jax.nn.soft_sign

next

jax.nn.swish