AGI: Google’s Mixture of Depths is a Baby Step Towards Artificial General Intelligence (AGI) LLMs, mixture-of-depths, mixture-of-experts, MoD, MoE