How To Make AI The Best Thing To Happen To Us
Max Tegmark: I’m optimistic that we can thrive with advanced AI as long as we win the race between the growing power of our technology and the wisdom with which we manage it. But this requires ditching our outdated strategy of learning from mistakes. That helped us win the wisdom race with less powerful technology: We messed up with fire and then invented fire extinguishers, and we messed up with cars and then invented seat belts. However, it’s an awful strategy for more powerful technologies, such as nuclear weapons or superintelligent AI — where even a single mistake is unacceptable and we need to get things right the first time. Studying AI risk isn’t Luddite scaremongering — it’s safety engineering.