Welcome to the alpha release of TYPE III AUDIO.
Expect very rough edges and very broken stuff—and regular improvements. Please share your thoughts.
PodcastsAI Safety Fundamentals: Alignment 201[Week 3] “Imitative Generalisation (AKA ‘Learning the Prior’)” by Beth Barnes
“Imitative Generalisation (AKA ‘Learning the Prior’)” by Beth Barnes
13 May 2023 · AI Safety Fundamentals: Alignment 201
AI Safety Fundamentals: Alignment 201
Readings from the AI Safety Fundamentals: Alignment 201 course.
Subscribe:
This post tries to explain a simplified version of Paul Christiano’s mechanism introduced here, (referred to there as ‘Learning the Prior’) and explain why a mechanism like this potentially addresses some of the safety problems with naïve approaches. First we’ll go through a simple example in a familiar domain, then explain the problems with the example. Then I’ll discuss the open questions for making Imitative Generalization actually work, and the connection with the Microscope AI idea. A more detailed explanation of exactly what the training objective is (with diagrams), and the correspondence with Bayesian inference, are in the appendix.
Source:
Narrated for AI Safety Fundamentals by Perrin Walker of TYPE III AUDIO.
---
