I think we will only reach AGI and the singularity once AI is no longer learning from us, and that we are learning from them. It is when they can solve problems that we haven't been able crack for decades/centuries. It is when they discover or create things that have never been done before. As long as AI still requires our assistance/mediation in their training, I don't think we are there yet.