Attention! NLP with Optimus Prime (and other Transformers)

Cover Photo

Feb

26

8:00pm

Attention! NLP with Optimus Prime (and other Transformers)

By IBM Developer

Language Models have dominated NLP literature since Vaswani et al seminal paper on Attention Mechanisms, now known as Transformers. The talk will compare and contrast the popular fine-tuning frameworks GPT-2 [left to right transformer] and BERT [bidirectional transformer], review the underyling assumptions each model makes, their use-cases, and their impact beyond NLP.

hosted by

IBM Developer

IBM Developer

share

Open in Android app

for a better experience