I would be testing each display individually with others unplugged
I will check schematics tomorrow as I can't remember what drives the 1 segment. On system 1 games the use two separate chips, ls21 from memory, to drive the 1 segments, can't remember if system 80 is the same, so I wil check tomorrow. Also I have seen crook 5101 ram cause display issues.