This post is about words. Specifically, an intuition about words, one which is meant to grasp at the aboutness of a text. The idea is simple: that not all words are equally valuable. Here, I’ll introduce one of the foundational ways that people have tried to formalize this intuition: TF-IDF.
An enjoyable film on frames of reference from 1960, with Donald Ivey – for the Canadians, he was the original Nature of Things host – and Patterson Hume. Internet archive says it well:
The fine cinematography by Abraham Morochnik, and funny narration by University of Toronto professors Donald Ivey and Patterson Hume is a wonderful example of the fun a creative team of filmmakers can have with a subject that other, less imaginative types might find pedestrian.