Entropy calculator in Common Lisp

A snippet I have found very useful when doing information theory. It can assemble characters, numbers, words, or really whatever you want (you have to write the tokenizer) into a PMF and tell you various information-theoretic things about it. Snippet is released under the GPLv3. (defun new-pmf () (let ((pmf nil)) (lambda (msg obj) (case… Continue reading “Entropy calculator in Common Lisp”