In The Elder Scrolls V: Skyrim for the PC, PS3, and Xbox 360, any object that can be picked up can also be moved instead.
If you’re having trouble figuring out how, that’s because there really isn’t a prompt for it, it just says “Press such and such button to take”, but if you press and HOLD the button you normally press to take the object, you grab it and be able to move it, pressing the button again to drop it wherever you want.
Moving objects around is not considered stealing since you’re not putting it into your inventory, so you can literally use this to move objects you want to steal later into better “lower traffic” areas.