mxnet.gluon.nn.LeakyReLU¶

class mxnet.gluon.nn.LeakyReLU(alpha, **kwargs)[source]¶

Leaky version of a Rectified Linear Unit.

It allows a small gradient when the unit is not active

\[\begin{split}f\left(x\right) = \left\{ \begin{array}{lr} \alpha x & : x \lt 0 \\ x & : x \geq 0 \\ \end{array} \right.\\\end{split}\]

Parameters: alpha (float) – slope coefficient for the negative half axis. Must be >= 0.

Inputs:

data: input tensor with arbitrary shape.

Outputs:

out: output tensor with the same shape as data.

__init__(alpha, **kwargs)[source]¶: Initialize self. See help(type(self)) for accurate signature.

Methods

`__init__`(alpha, **kwargs)	Initialize self.
`apply`(fn)	Applies `fn` recursively to every child block as well as self.
`cast`(dtype)	Cast this Block to use another data type.
`collect_params`([select])	Returns a `ParameterDict` containing this `Block` and all of its children’s Parameters(default), also can returns the select `ParameterDict` which match some given regular expressions.
`export`(path[, epoch])	Export HybridBlock to json format that can be loaded by SymbolBlock.imports, mxnet.mod.Module or the C++ interface.
`forward`(x, *args)	Defines the forward computation.
`hybrid_forward`(F, x)	Overrides to construct symbolic graph for this Block.
`hybridize`([active])	Activates or deactivates `HybridBlock` s recursively.
`infer_shape`(*args)	Infers shape of Parameters from inputs.
`infer_type`(*args)	Infers data type of Parameters from inputs.
`initialize`([init, ctx, verbose, force_reinit])	Initializes `Parameter` s of this `Block` and its children.
`load_parameters`(filename[, ctx, …])	Load parameters from file previously saved by save_parameters.
`load_params`(filename[, ctx, allow_missing, …])	[Deprecated] Please use load_parameters.
`name_scope`()	Returns a name space object managing a child `Block` and parameter names.
`register_child`(block[, name])	Registers block as a child of self.
`register_forward_hook`(hook)	Registers a forward hook on the block.
`register_forward_pre_hook`(hook)	Registers a forward pre-hook on the block.
`save_parameters`(filename)	Save parameters to file.
`save_params`(filename)	[Deprecated] Please use save_parameters.
`summary`(*inputs)	Print the summary of the model’s output and parameters.

Attributes

`name`	Name of this `Block`, without ‘_’ in the end.
`params`	Returns this `Block`’s parameter dictionary (does not include its children’s parameters).
`prefix`	Prefix of this `Block`.