“We were discussing ... people to run OLA, an open weight model ... difference between OLA and VLLM and quantization, even from a high level.”
Omar Santos · Security & GRC Decoded · The Agents Ran All Weekend. They Came Back With Zero Days. ft. Omar Santos, Distinguished Engineer, AI Security @ Cisco
Play from 1:07:57
1:07:57
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Run open-weight AI models (e.g., OLA) and compare them to VLLM and quantized versions to teach students high-level differences
Said nearby on the same subject
“I have eight different local models, open weight models running right now in my house, in my attic... they all have personas. My most recent is GLM-5.3 persona.”