Remit not Paucity1

A blog to trace impunity and mutter in opacity.

3 May 2020

ICLR 2020 Trends: Better & Faster Transformers for Natural Language Processing

A summary of promising directions from ICLR 2020 for better and faster pretrained tranformers language models.

1.The blog name is a hat tip to Greg Egan's Permutation City, a great sci-fi novel exploring the nature of consciousness and reality. Remit not paucity is a timely admonition: in the intelligence age where possibilities seem endless, it's good to remember that constraints breed innovation. "Remit not paucity" is also a nice anagram of the novel's title. I came up with two more anagrams that fit well the "LLMs interpretability and auditing" theme, so I added them in the subtitle.