Mentally Disabled woman across the street is unsupervised for days on end. What can I do?

Caregiver frequently leaves her alone for long periods. There is a woman who lives across the street from me who's caregiver is frequently gone for 7 days or more and leaves this woman alone during those periods of time. As a result, this woman has taken to sitting out front of her house and flagging strangers down for help with stuff. Lately, she has been trying to enter our house without our permission and has been trying to steal items from our house. Im not sure what to do about her. I could call the police but I don't think that they can do anything.