Deconstructing BERT: Visualizing the Inner Workings of Attention

Details

Vancouver, BC USA. Date of Talk: 2019-10-21
Event

Deconstructing BERT: Visualizing the Inner Workings of Attention

We explore of the inner workings of the Transformer language model through visualization.

Additional information

Focus Areas

Our work is centered around a series of Focus Areas that we believe are the future of science and technology.

FIND OUT MORE
Commercialization Opportunities

We’re continually developing new technologies, many of which are available for¬†Commercialization.

FIND OUT MORE
News

PARC scientists and staffers are active members and contributors to the science and technology communities.

FIND OUT MORE