Welcome to the alpha release of TYPE III AUDIO.
Expect very rough edges and very broken stuff—and regular improvements. Please share your thoughts.
PodcastsAI Safety Fundamentals: Governance[Week 4] “Model evaluation for extreme risks” by Shevlane et al
“Model evaluation for extreme risks” by Shevlane et al
13 May 2023 · AI Safety Fundamentals: Governance
AI Safety Fundamentals: Governance
Readings from the AI Safety Fundamentals: Governance course.
Subscribe:
Current approaches to building general-purpose AI systems tend to produce systems with both beneficial and harmful capabilities. Further progress in AI development could lead to capabilities that pose extreme risks, such as offensive cyber capabilities or strong manipulation skills. We explain why model evaluation is critical for addressing extreme risks. Developers must be able to identify dangerous capabilities (through “dangerous capability evaluations”) and the propensity of models to apply their capabilities for harm (through “alignment evaluations”). These evaluations will become critical for keeping policymakers and other stakeholders informed, and for making responsible decisions about model training, deployment, and security.
Source:
https://arxiv.org/pdf/2305.15324.pdf
Narrated for AGI Safety Fundamentals by Perrin Walker of TYPE III AUDIO.
---
