It’s not inherently derogatory, but it does hold a connotation if you refer to women as females particularly in contexts where you wouldn’t/don’t refer to men as males.