As per my previous post, locate in the backbox connector J205 and with power off, disconnect it.  Power game up and play for a while.  See if problem persists.

The direct switches on these bypass the switch matrix and can only be one of two things generally.  Ground issue or MPU board issue.