No you can't. In guilds, even if you're a member, if you put your stuff in their containers and they catch you removing it later, they turn hostile because they think you're stealing it. This is also the case with containers outside houses if guards see you removing your own stuff from them, though there are a number of out of the way boxes for example in Balmora you can use without guards seeing you.
You can put stuff down safely knowing that it won't disappear, however. You can actually leave all your stuff in the middle of the street and it will all be there forever. For rp-ing purposes though, it's best to find an empty house to use, download a residence mod, or use your own house you can get by being high up in one of the great houses.
__________________
|