CMU research shows compression alone may unlock AI puzzle-solving abilities
A pair of Carnegie Mellon University researchers recently discovered hints that the process of compressing information can solve complex reasoning tasks without pre-training on a large number of examples. Their system tackles some types of abstract pattern-matching tasks using only the puzzles themselves, challenging conventional wisdom about how machine learning systems acquire problem-solving abilities. “Can lossless information compression by itself produce intelligent behavior?” ask Isaac Liao, a first-year PhD student,…