4 Comments
User's avatar
E. Thomas Thomas's avatar

This was really good. I'm mostly convinced that the best way forward for humanity is to eventually concede governance to synthetic intelligence.

Expand full comment
Space Cadet Michael's avatar

Thank you. I am glad you enjoyed it! I must say that I am rather concerned with the idea of such a future and am not at all certain it is an optimal way forward. Ceding much of the analysis, sure. But decision-making, not so sure. We need to be able to have some level of certainty that our governors share our goals and values. (In this case Ava seems to, but can synthetic intelligence ever? It remains to be seen)

Expand full comment
E. Thomas Thomas's avatar

The thing is that not all human goals and values are good goals and values, and they aren't universally shared among humans. What would be worse: A superintelligence with a bias towards the goals and values of one group, or a superintelligence with goals and values that are novel and alien?

Expand full comment
Space Cadet Michael's avatar

Great point! It is messy and complicated in reality. I don't think its possible to answer your question because the true answer lies in the nuance of the details which are not yet known.

Expand full comment