I also have this phenomenon and thought about an explanation, as there isn’t any research regarding this topic: The relative density and distribution of cones in the eyes can vary slightly between eyes, which could lead to minimal differences in color perception. There could also be microscopic differences in the structure of the crystalline lens, the cornea or the vitreous body, which could refract or filter the light differently and thus slightly influence the perceived color temperature.