I get that. My intuition often mixes both up, too.

That’s why I trained myself to say “driver-side” and “passenger-side” in my head when left or right come up. To a point where I don’t even have to think about thinking about it. I just visualize which side of car is meant instead of the rather abstract concept of left and right

Might not help you; but it helps me