
Hi,
Has he got a bed of his own? Sometimes the reason that they dig up furniture, carpets etc, is because they are trying to get comfortable and make a bed, much like wolves do in the wild and a bed of their own can help, if he is that way inclined then he will probably still dig at his bed but at least it isn't your couch :D put the bed Somewhere that he can go to relax and feel safe, perhaps with some treats to eat or a favourite toy.
I agree with putting the bin outside or in the sink, then there is no chance that this can happen again. ;)
Does he have a good walk before you both leave him? As tiring him out and leaving him with a stuffed kong and some other toys before you leave can also help. It sounds like he is a little bit insecure, hence he shadows you all the time, if you can build his confidence you should find that he will settle down and grow out of it. HTH :)
Edited to say: having just seen your last post, I agree totally with JG, it is a behaviour that he has learned, not an admission of guilt.