“They created an open source version of BERT… pivot… to becoming a marketplace for language models… going deeper in the same space”

“When transformers came out, the paper… quickly converted it into PyTorch… they open source it and went viral on GitHub.”

“There is an agent role called the cartographer... that creates a threat model. You can do this in two ways... threat model after the code is created”

“…when the transformer came out, it was literally, as soon as the paper came out, literally the next day… it was clear… that transformers address the limitations of recurrent neural networks of learning long-term dependencies.”

“We invented HDL, the Intel Hardware Description Language. I wrote my own language. ... we created a compiler for the language.”