Take a look at the nutrition values of the various kinds of cheeses (where I live it usually lists the macros right on the package). Milk is about 3% carbohydrates/sugar (i.e. 3% lactose), while most cheeses that aren’t white have about 0% sugar.