Patterson was willing to move up, but you would not know this. It was common for 175lb fighters to move up as it is common for cruiserweights nowadays because it was the last division back then. hence the name.
Also, he was afraid of Liston and retired early. In any case, he was still no ATG. And you say he was proven but that is very arguable, very arguable indeed.