In Vanquish for the PS3 and Xbox 360, when you die you typically lose some of your weapon upgrades.
To keep this from happening, choose to return to the title screen instead of retrying, and then continue.
This will also erase your death count, so if you do this every time you die you should get the Living Legend achievement/trophy since your death is never recorded.