MultiheadAttention.ConfigΒΆ

Component: MultiheadAttention

class MultiheadAttention.Config[source]

Bases: ConfigBase

All Attributes (including base classes)

dropout: float = 0.0
kdim: Optional[int] = None
vdim: Optional[int] = None
bias: bool = True

Default JSON

{
    "dropout": 0.0,
    "kdim": null,
    "vdim": null,
    "bias": true
}