24/96 WAV - Playing Problems

Hi, here’s my spec.

Rasberry Pi model B with HifiBerry DAC.

When I play 24 bit 96 wavs the sound comes out broken up and too fast. However, after noodling around the interface I found it will play these with ‘Volume normalisation’ set to ‘yes’. Weird… I can’t live with the normalisation (reminds me of cassette auto level control!) - my workround (even more weird) is to upsample to 32bit 44 on fastest interpolation - then it works. Really want to keep things simple, any suggestions?