Athletic director Steve Patterson is gone, too, after less than two years — an abrupt end to his rocky tenure atop the nation’s wealthiest athletic program that remains in turmoil.