In fact there is always some ninja chocobos in your stable. You dont see them because they are in stealth mode but they are here for sure, pooing everywhere in it. I am afraid you dont have any other choice than removing your stable, so that they go degrading a neighbor's one. With some luck, it will make someone you dont like waste numerous costly magical brooms.