Category: Uncategorized

This blog is in progress. (AJM, Friday, Aug. 30, 2024; 09:00 AM HI Time) This blogpost accompanies the YouTube on “AGI: Action Perception Divergence (APD) vs. Renormalizing Generative Models (RGMs)” This blogpost – and the accompanying YouTube – is in response to a question asked in the Comments section of the prior YouTube. Here’s that… Continue reading Contrast-and-Compare: Friston et al. (2024) and Hafner et al. (2022)

Three weeks ago, the AGI world tilted on its axis. More specifically, Friston et al. (2024) introduced an evolutionary advance in active inference, which they call renormalising generative models (RGM). This blogpost addresses three key questions: Here’s the YouTube that accompanies this blogpost: Background Friston’s evolution of active inference is one of the key methods… Continue reading Big AGI Breakthrough: Leveling the Playing Field

Last night, a bit blurry-eyed from video editing, I cruised the latest AI news to find yet a new trouble-spot with LLMs. When an LLM is recursively trained on its own output, then that LLM’s output becomes progressively degraded. I went to bed with that thought swimming in my head … and woke up with… Continue reading How Training LLMs Is Like Salmon Farming (Three Parallels)

One of the two “world model” methods that we’re considering for AGI is APD (Action Perception Divergence), an evolution of active inference, introduced by Hafner et al. in 2022. This blogpost accompanies the fourth vid in the AGI YouTube series. Previously in This Series … This blogpost is fourth in a series, as is the… Continue reading Action Perception Divergence: A Potential AGI Contributor

The primary focus of this blogpost and the corresponding YouTube is on LeCun’s architecture, centered on the (Hierarchical) Joint Embedding Predictive Architecture (JEPA, or H-JEPA). This will be foundational to a contrast-and-compare with Action Percept Divergence (APD) (Hafner et al., 2022), which we’ll evolve over this Summer, 2024 YouTube/blogpost series. This blogpost accompanies a YouTube… Continue reading Comparing Three Leading AGI Contenders (Part 1 of Many)

It’s more than just legislation – although a “generative AI labeling” bill is in committee in both the U.S. Senate and the House. California has just passed a first effort at legislating extreme AI behaviors, and Texas (another bellwether state) also has AI legislation in committee. So let’s start with a quick recap of WHY… Continue reading AI Legislation, Safety, and Mis-Use Cases

There are three fundamentally different forms of AI:  Most of the attention now is on transformer-based methods, which are a particular form of generative AI. Generative AI comes in several forms, of which transformers are the most recent. 

We’re building our AGI discussion around a few core papers. The ones identified here are either central to our discussion – and will be featured across multiple YouTubes and blogposts (and also front-row in our AGI 101 Themesis course), or are hugely and supremely supportive of our studies. This blogpost specifically correlates with THIS YOUTUBE:… Continue reading AGI Basics: Five Key Reads

This is a blogpost-in-progress. It is intended to provide resources accompanying a YouTube that I plan to put out this week. Check back for more as the week progresses – thank you! – AJM (Monday, May 6th, 2024; 1AM Hawai’i time) Resources and References From the Prologue to LeCun’s work: This document is not a… Continue reading AGI: Fundamental Concepts (Getting Started Reading List)

Four years ago, tech journalist and old friend Lee Goldberg asked me to semi-/sort-of collaborate with him on his yearly April Fool’s (April 1st) day article. Basically, Lee had a really fun idea for writing about “artificial stupidity,” instead of “artificial intelligence,” and he asked me to give him some real-AI credibility to use in… Continue reading Generative AI: A Teenager Acting Out