A world without boarder would be chaotic. It would be extremely difficult to keep track of criminals like you have stated. Lagos is overpopulated today because many Nigerians saw opportunities only in Lagos because it relatively more developed. The patience of developing individual's place of birth is not there.
Such would be the case between developed and developing countries if there are no boarders. Honestly, the disadvantages outweighs the advantages as you mentioned.