SelfAttention.ConfigΒΆ
Component: SelfAttention
-
class
SelfAttention.
Config
[source] Bases:
ConfigBase
All Attributes (including base classes)
- attn_dimension: int =
64
- dropout: float =
0.4
Default JSON
{
"attn_dimension": 64,
"dropout": 0.4
}