Pratt & Whitney interview question

NLP Encoder Decoder models, BERT?