Last night, a bit blurry-eyed from video editing, I cruised the latest AI news to find yet a new trouble-spot with LLMs. When an LLM is recursively trained on its own output, then that LLM’s output becomes progressively degraded. I went to bed with that thought swimming in my head … and woke up with… Continue reading How Training LLMs Is Like Salmon Farming (Three Parallels)
Author: AJ Maren
Action Perception Divergence: A Potential AGI Contributor
One of the two “world model” methods that we’re considering for AGI is APD (Action Perception Divergence), an evolution of active inference, introduced by Hafner et al. in 2022. This blogpost accompanies the fourth vid in the AGI YouTube series. Previously in This Series … This blogpost is fourth in a series, as is the… Continue reading Action Perception Divergence: A Potential AGI Contributor
Comparing Three Leading AGI Contenders (Part 1 of Many)
The primary focus of this blogpost and the corresponding YouTube is on LeCun’s architecture, centered on the (Hierarchical) Joint Embedding Predictive Architecture (JEPA, or H-JEPA). This will be foundational to a contrast-and-compare with Action Percept Divergence (APD) (Hafner et al., 2022), which we’ll evolve over this Summer, 2024 YouTube/blogpost series. This blogpost accompanies a YouTube… Continue reading Comparing Three Leading AGI Contenders (Part 1 of Many)
AI Legislation, Safety, and Mis-Use Cases
It’s more than just legislation – although a “generative AI labeling” bill is in committee in both the U.S. Senate and the House. California has just passed a first effort at legislating extreme AI behaviors, and Texas (another bellwether state) also has AI legislation in committee. So let’s start with a quick recap of WHY… Continue reading AI Legislation, Safety, and Mis-Use Cases
AGI 101- Week 1: Knowledge Representation in AGIs
There are three fundamentally different forms of AI: Most of the attention now is on transformer-based methods, which are a particular form of generative AI. Generative AI comes in several forms, of which transformers are the most recent.
AIs Acting Out: Crazy and Malicious
Our primary focus – not just for these next few months, but likely for the next few years – will be artificial general intelligence. That said, it’s useful to assess the landscape – because evidence suggests a real sea change in how people are viewing AI. We’ll highlight some of the recent works identifying weaknesses… Continue reading AIs Acting Out: Crazy and Malicious
AGI Basics: Five Key Reads
We’re building our AGI discussion around a few core papers. The ones identified here are either central to our discussion – and will be featured across multiple YouTubes and blogposts (and also front-row in our AGI 101 Themesis course), or are hugely and supremely supportive of our studies. This blogpost specifically correlates with THIS YOUTUBE:… Continue reading AGI Basics: Five Key Reads
Emerging AGIs: Early 2024 Playing Field
AGI is not here … just yet. [*BLOGPOST IN PROGRESS – CHECK BACK FOR DAILY UPDATES!* (AJM, Tuesday, May 14, 2024; 0200 Hawai’i Time)] But – it’s getting close. Very, VERY close. What’s interesting – and important to all of us – is that there is no “singular” AGI, and it’s important to make this… Continue reading Emerging AGIs: Early 2024 Playing Field
AI, Climate, and Energy (Resource Collection)
One of the most important things in the emerging AI-world is how we handle the ENERGY NEEDS of AI systems. This actually invokes a much bigger question – how will we handle energy needs overall? How do we mitigate (and potentially reverse) the climate crisis? How do we build sustainability and resilience into our energy… Continue reading AI, Climate, and Energy (Resource Collection)
AGI: Fundamental Concepts (Getting Started Reading List)
This is a blogpost-in-progress. It is intended to provide resources accompanying a YouTube that I plan to put out this week. Check back for more as the week progresses – thank you! – AJM (Monday, May 6th, 2024; 1AM Hawai’i time) Resources and References From the Prologue to LeCun’s work: This document is not a… Continue reading AGI: Fundamental Concepts (Getting Started Reading List)