This blog is in progress. (AJM, Friday, Aug. 30, 2024; 09:00 AM HI Time) This blogpost accompanies the YouTube on “AGI: Action Perception Divergence (APD) vs. Renormalizing Generative Models (RGMs)” This blogpost – and the accompanying YouTube – is in response to a question asked in the Comments section of the prior YouTube. Here’s that… Continue reading Contrast-and-Compare: Friston et al. (2024) and Hafner et al. (2022)
Author: AJ Maren
Big AGI Breakthrough: Leveling the Playing Field
Three weeks ago, the AGI world tilted on its axis. More specifically, Friston et al. (2024) introduced an evolutionary advance in active inference, which they call renormalising generative models (RGM). This blogpost addresses three key questions: Here’s the YouTube that accompanies this blogpost: Background Friston’s evolution of active inference is one of the key methods… Continue reading Big AGI Breakthrough: Leveling the Playing Field
How Training LLMs Is Like Salmon Farming (Three Parallels)
Last night, a bit blurry-eyed from video editing, I cruised the latest AI news to find yet a new trouble-spot with LLMs. When an LLM is recursively trained on its own output, then that LLM’s output becomes progressively degraded. I went to bed with that thought swimming in my head … and woke up with… Continue reading How Training LLMs Is Like Salmon Farming (Three Parallels)
Action Perception Divergence: A Potential AGI Contributor
One of the two “world model” methods that we’re considering for AGI is APD (Action Perception Divergence), an evolution of active inference, introduced by Hafner et al. in 2022. This blogpost accompanies the fourth vid in the AGI YouTube series. Previously in This Series … This blogpost is fourth in a series, as is the… Continue reading Action Perception Divergence: A Potential AGI Contributor
Comparing Three Leading AGI Contenders (Part 1 of Many)
The primary focus of this blogpost and the corresponding YouTube is on LeCun’s architecture, centered on the (Hierarchical) Joint Embedding Predictive Architecture (JEPA, or H-JEPA). This will be foundational to a contrast-and-compare with Action Percept Divergence (APD) (Hafner et al., 2022), which we’ll evolve over this Summer, 2024 YouTube/blogpost series. This blogpost accompanies a YouTube… Continue reading Comparing Three Leading AGI Contenders (Part 1 of Many)
AI Legislation, Safety, and Mis-Use Cases
It’s more than just legislation – although a “generative AI labeling” bill is in committee in both the U.S. Senate and the House. California has just passed a first effort at legislating extreme AI behaviors, and Texas (another bellwether state) also has AI legislation in committee. So let’s start with a quick recap of WHY… Continue reading AI Legislation, Safety, and Mis-Use Cases
AGI 101- Week 1: Knowledge Representation in AGIs
There are three fundamentally different forms of AI: Most of the attention now is on transformer-based methods, which are a particular form of generative AI. Generative AI comes in several forms, of which transformers are the most recent.
AIs Acting Out: Crazy and Malicious
Our primary focus – not just for these next few months, but likely for the next few years – will be artificial general intelligence. That said, it’s useful to assess the landscape – because evidence suggests a real sea change in how people are viewing AI. We’ll highlight some of the recent works identifying weaknesses… Continue reading AIs Acting Out: Crazy and Malicious
AGI Basics: Five Key Reads
We’re building our AGI discussion around a few core papers. The ones identified here are either central to our discussion – and will be featured across multiple YouTubes and blogposts (and also front-row in our AGI 101 Themesis course), or are hugely and supremely supportive of our studies. This blogpost specifically correlates with THIS YOUTUBE:… Continue reading AGI Basics: Five Key Reads
Emerging AGIs: Early 2024 Playing Field
AGI is not here … just yet. [*BLOGPOST IN PROGRESS – CHECK BACK FOR DAILY UPDATES!* (AJM, Tuesday, May 14, 2024; 0200 Hawai’i Time)] But – it’s getting close. Very, VERY close. What’s interesting – and important to all of us – is that there is no “singular” AGI, and it’s important to make this… Continue reading Emerging AGIs: Early 2024 Playing Field