It is all a part of it. The challenge is what is in the database to begin with. Here is where the community dictates things. An algo isnt going to do anything is people do not participate in training it.
As for the retrieval, that is a problem for Hive.