I just became aware of
Vermeersch, Etienne (1963). Information and Philosophy. Philosophica 1.
Freely available here
a very early attempt to analyse “information” philosophically. There are further references to earlier literature as well, mainly in cybernetic- oriented contexts. All interesting from a historical perspective on the origin of PI.