Definitely! Code is a liability, because the more code, the more potential for bugs, including security bugs.
The ideal situation is to have the least code that will actually do the job.
Indeed! "Perfection is when there is nothing more to take away, rather than nothing more to add".
There's also a joke in software circles that every program contains at least one bug and can be optimized by at least one instruction -- and that therefore all software is reducible to a single instruction that doesn't work