I agree with you, and the D700 is very close to the D3 anyway. You really are not missing much, the D700 is excellent and I doubt you would see much, if any, difference in the real world.
I think the camera is probably near the bottom of the list, for good images. Glass and post can...