No matter what lens you buy, there's always a sweet spot for shooting. If I'm not wrong, the sweet spot for the 24mm should be f/8. Look at the MTF charts and you will understand.
Also, the earlier lenses are designed for film. I believe one of the guys here have already explained. The digital sensors are not so good at handling light coming from an angle. That's probably the reason why Nikon marketed the term, FX lense. 'cos they probably know that the older film lenses will not work very well on the FX sensors. Setting the aperature at the sweet spot will help. On the other hand, the older film lenses work very well with the DX sensors.
If you are shooting at 24mm, which is a wide angle lens, most will shoot at small aperature to get an even sharpness across. Unless you have something out-of-the-box that you are trying.