How much of the energy consumed in an AI chip is spent doing something useful? This question affects everything from software to system architecture to chip design.