In the late Middle Ages single-letter words were written with per se (meaning ”by itself”) and the letter repeated. For example, I would be I per se, I. The & symbol was included with many alphabet lists at the time and read as and per se, and. Over time, this became ampersand.