In [Harry Potter and the Deathly Hallows] it is revealed that three brothers Antioch, Cadmus, and Ignotus were the original holder of the deathly hallows. As the cloak of invisibility was passed on in the family, [we know] Harry is a descendant of the Peverell family. Also, there is a good chance that the resurrection stone was also passed on as a family heirloom because Tom Riddle's grandfather had it on his ring.
So it seems that both Harry and Voldemort were very distant relatives.
— Quora user Aman Ved Kalia