I’ve ingrained this in my brain by doing hand motions whenever I say “port and starboard”. I throw my left hand out to my left when I say port and right hand when I say starboard. The muscle memory stops me from forgetting.