Stranger Danger!
If it’s not a small set or a closed set (well, why isn’t it?), make sure that the people who are supposed to be there (cast & crew) have badges or some other clear and obvious identifier. Everybody should keep their eyes out for people who don’t have this identifier.