Singular nouns ending in a consonant + y form their plurals by dropping y and adding ies. 'Lady' ends in 'dy' (consonant + y), so 'ladies' is correct.
SSC (Class 9-10) › English Grammar and Composition › Chapter 1: The Noun › Topic: Number (Singular and Plural Forms)
Aligned to the NCTB national curriculum.