If you want to build a recursively self-improving AI, have it go through a billion sequential self-modifications, become vastly smarter than you, and not die, you've got to work to a pretty precise standard.

— Eliezer Yudkowsky, Less Wrong Q&A with Eliezer Yudkowsky (2010)

Source: http://lesswrong.com/lw/1lq/less_wrong_qa_with_eliezer_yudkowsky_video_answers/

Answer to question 12 in a January 2010 video Q&A.

Topics: software engineering