SequenceAttentionLayer

SequenceAttentionLayer is being phased out in favor of AttentionLayer, which was introduced in Version 12.0.

SequenceAttentionLayer[]

is equivalent to AttentionLayer[] with a single "Input" port instead of ports "Key" and "Value". It should no longer be used.

SequenceAttentionLayer[net]

is equivalent to AttentionLayer[net] with a single "Input" port instead of ports "Key" and "Value". It should no longer be used.

Details

  • SequenceAttentionLayer[net] will evaluate to AttentionLayer[net] with a single "Input" port.
Introduced in 2017
(11.1)