The Meltdown and Spectre exploits have made mainstream news over the last three days, to the point that you would think the heavens were raining fire. Now, we're not here to downplay the seriousness of the revelation two decades' worth of hardware vulnerabilities, but we will speak with a calm voice. We ran a few tests to measure the performance impact of Microsoft's new Meltdown patch on the fastest storage device available.
Early testing from the blogsphere shows storage performance falling victim to Microsoft's early patch. The patch does cause some performance loss, but it's primarily confined to enterprise-class workloads, where some have pegged regressions at 20% and even 30% with synthetic workloads.
We chose Intel's Optane 900P 480GB to measure the impact of Microsoft's patch in synthetic and real-world performance. The 900P with 3D XPoint memory technology will show the largest performance gap between pre- and post-patch performance. Many storage tests with normal NAND-based SSDs are subject to the usual inconsistent performance we see with SSDs, which may be a factor in some of the test results already posted online. Optane doesn't require preconditioning to generate consistent test results between test runs, so it's well-suited for providing rock-solid reproducible benchmark results with a minimum of extra testing gymnastics.
Synthetic workloads show what could be possible--in this instance, the worst-case scenario--but we've warned about using synthetic tests to gauge performance. These tests isolate individual components as best as possible, but in the real world, your components work together, not separately. When it comes to modern storage, the software is the bottleneck rather than the hardware components.
Anvil Storage Utilities, a popular one-click synthetic performance benchmark used widely in forums, shows the largest performance loss after the update. We see a big reduction in random write performance during the test. We lost more than half of the random write performance with a 4K random workload at QD4, and we receive ~5x less performance at QD16. We also lose quite a bit of performance at the all-important QD1.
However, synthetic benchmarks track multiple axes of performance in real-time during the workload. We theorize that rapidly querying the system for this telemetry data could exacerbate the issue with system calls, which are the primary source of performance reductions with the new patch.
For the final score, the software also weights random over sequential performance and emphasizes write speeds rather than read speeds. The software came to market in mid-2011 when random write performance was much lower than it is today. Since 2011, random data write latency has surpassed what Windows is capable of using in most consumer workloads. This why, as we noted above, the bottleneck has moved from the hardware to the software.
Those losses occur in a synthetic benchmark that is likely inflating the performance reduction, but we set out to see if that performance reduction occurs with an application-based workload. We're using FutureMark's PCMark 8 Storage Test to look at consumer application performance where random data reads have a larger impact on performance.
The time to completion was identical between pre- and post-patch application testing in all but one test. The only workload to show a difference came in the Adobe Photoshop Heavy Workload that takes more than five minutes to complete. We recorded a 0.1 second difference.
With the results averaged and presented as a throughput score, we see only a 46.29 MB/s difference, or 3.21%. For some that may seem like a large number, but for perspective, even if we didn't update the operating system, we would see the same difference with this device if we swapped it between motherboards, BIOS updates, or even adjusted the system memory timings.
The performance gap should decrease as we test with less-capable storage products. We're still exploring performance across a wide range of storage and processor types, and we will update if we find conflicting results. As of now, a 3.21% performance drop on an Intel Optane SSD 900P isn't the end of the world and isn't going to be noticeable with the majority of applications.
