In this lecture, part of the celebration event for the tenth anniversary of the Andrew Wiles Building, home to Oxford Mathematics, Andrew himself traces the background to the one of the most famous series of conjectures in modern mathematics, starting in the sixteenth century with a poem.