There's some cat-b-gone kinda stuff you can buy that will deter them.

Or if you are cheap and evil you just sprinkle cayenne pepper on your balcony...I did that for raccoons once, worked like a charm.