Bottleneck (context vector bottleneck)
The design flaw in plain seq2seq (Paper 06): the entire source sentence's meaning must be compressed into a single fixed-size vector before decoding can begin.
The design flaw in plain seq2seq (Paper 06): the entire source sentence's meaning must be compressed into a single fixed-size vector before decoding can begin. For long sentences, important information is lost during this compression.