Ethically, how close can you fish to a "permanent"  ice house / shanty that is not occupied.  Repeat - not occupied.

If I get out their early and "nobody is home" how close can I fish.   I'm not talking feet - I'm talking yards.    I respect the space but how much territory is theirs to claim.   I fish out of a portable ice house.

Do you leave when someone finally arrives - if they do?