If you hadn't been so ugly to me

Mother: If you hadn’t been so ugly to me, we could’ve gone together.
Daughter: I’m recovering from surgery.

Question: What does “ugly” mean in this sentence exactly?
Is it common to say someone is ugly to me?

Thank you!!!

She is saying “If you hadn’t been so horrible/mean/nasty to me”. I don’t think I’ve ever heard anyone saying that someone is ugly to them in real life before.