Deconstructing BERT: Visualizing the Inner Workings of Attention
Details
Vancouver, BC USA. Date of Talk: 2019-10-21
Speakers
Jesse Vig
Event
Deconstructing BERT: Visualizing the Inner Workings of Attention
We explore of the inner workings of the Transformer language model through visualization.
Additional information
Focus Areas
Our work is centered around a series of Focus Areas that we believe are the future of science and technology.
Licensing & Commercialization Opportunities
We’re continually developing new technologies, many of which are available for Commercialization.
News
PARC scientists and staffers are active members and contributors to the science and technology communities.