I think part of the reason ChatGPT is hard to understand is that we lack the foundational concepts to build upon when reasoning about it.