SelfAttention.Config

Component: SelfAttention

class SelfAttention.Config

Bases: ConfigBase

All Attributes (including base classes)

attn_dimension: int = 64

dropout: float = 0.4

Default JSON

{
    "attn_dimension": 64,
    "dropout": 0.4
}