As per my previous post, locate in the backbox connector J205 and with power off, disconnect it. Power game up and play for a while. See if problem persists.
The direct switches on these bypass the switch matrix and can only be one of two things generally. Ground issue or MPU board issue.