Over on Every byte matters you can read about the effect on performance of your memory layout and cache usage.