← Dictionary / Bidirectional context

Bidirectional context

Appears in 1 paper

A representation built from both left and right context simultaneously.

As used in Paper 11 — BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding →

A representation built from both left and right context simultaneously. When BERT represents the word "bank" in a sentence, it uses all tokens to the left AND all tokens to the right to determine which meaning is correct.

Appears in papers

Paper 11 — BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding →