The Kits and The Markets

In our Haswell DDR3 scaling article, we introduced the concept of a Performance Index in order to compare memory kits of different frequencies and latencies against overall performance. The Performance Index is calculated by the rated speed divided by the CAS latency such that:

Performance Index = Frequency / CL

At the time it came across as a good indicator of performance when buying from the shelf, although most companies do not particularly advertise the latencies on the package. Our conclusion for DDR3 on Haswell was that the higher the Performance Index the better, although with two potential options close together, the one with the higher frequency is the better choice. So for example, when given DDR3-2133 C10 (PI of 213) against DDR3-1866 C10 (PI or 187), the first one should be chosen. However with DDR3-2133 C10 (PI of 213) and DDR3-2400 C12 (PI of 200) at the same price, the results would suggest the latter is a better option.

One of the big issues that the Performance Index does not take into account is the price, which fluctuates weekly depending on DRAM supply but also the capabilities of a kit through rarity. When purchasing memory ICs from the big three (Samsung, SK Hynix, Micron), the chips themselves are only rated at a basic speed and it is up to the module manufacturer to do further binning to find the best silicon for the high speed memory kits. As a result many of these companies will bid on certain batches with a history of high performance, and then the extra time required to separate the good chips from a batch adds into the high cost of the top frequency kits. Usually frequency defines the difficulty, rather than the sub-timings and latency because frequency is a defining factor.

When it comes to DDR4, we will be taking a similar broad approach to kit designation, taking the Performance Index of each memory kit in each benchmark and attempting to find a correlation.

The Market

At launch, DDR4 kits had the obvious premium of being a new technology as well as being is short supply due to Intel moving up the date for release. The prices at this time, as we reported, were the equivalent to $213 for a 4x4GB 2133 C15 kit going through $300 for a 4x4 GB 2666 C15 up to $413 for 4x4GB 3000 C15. Based on these numbers it would seem that the high end modules have come down in price quickly, but the lower range products have stayed similar. We took a range of pricing from Newegg to see the effect of being at market for just over six months has done.

The cheapest standard kit of 2133 C15 4x4 GB comes in at $200. The best kit in this layout would be towards the bottom left, as indicated by the performance index in each square:

Here I have marked four areas, representing the low end memory in orange, the more standard in white, the performance modules in green and the super-high performance in dark green. There are currently no modules in that last group, going through all the pricing from 2x8GB kits to 8x8GB kits:

The lowest price per GB is at $387 for 4x8GB of DDR4-2133 C15, at $12.09 per GB, compared to $1800 for 8x8GB of 2800 C16 which makes out to $28.13 per GB.

The interesting segments based on price alone that catch my in that case are:

4x4GB DDR3-2133 C13 for $213
4x8GB DDR3-2133 C13 for $400
At this point, a CAS latency below 15 is something of a novelty. It seems a little more esoteric than usual, as none of the manufacturers we spoke to even considered sampling us something of this nature. I would be interested to actually see how it performs.
4x4GB DDR4-2666 C13 for $290
4x4GB DDR4-3000 C15 for $300
I picked both of these based on the closeness of price and on Performance Index. The latter kit is something we have in for review, but similar to the previous kits listed, a CAS latency of 13 is an interesting element to the equation.
4x8GB DDR4-2800 C15 for $510 Measuring up at nearly $16 per GB, this kit mixes the elements of on-paper specifications, density and price for a nice X99 system.

The Kits

For this roundup and subsequent reviews, we received kits from almost every major memory manufacturer. G.Skill, Corsair, ADATA and Crucial were all willing to send various speeds and densities of memory, ranging from the basic 4x4 GB of DDR4-2133 C15 to 8x8GB of DDR4-2133 C15, or 8x8GB of DDR4-2400 C16 to 4x4GB of DDR4-3200 C16.

The main conclusions from this testing will be from the 4x4 GB modules in order to keep consistency, however the 4x8 GB and 8x8 GB results will be included for comparison. Larger modules (and more modules in a kit) tend to lead to relaxed sub-timings in order to ensure full compatibility with all CPUs in all motherboards. This means that in synthetic testing we may end up with some slightly different results, although this may differ in real-world tests.

Another point to note is module compatibility. When DDR4 was first launched with Haswell-E in September 2014, compatibility issues were a problem. Intel had moved up the time of the launch from mid-September to early September very late in the day, leaving memory vendors to scramble kits to market. This gives them a shorter time to work with ASUS, GIGABYTE, MSI and ASRock in order to insure no issues when working with motherboards, especially with high end memory. Due to this shortened timeframe there were some issues to begin with but these should have been ironed out since. Also on the high speed memory front, it would seem that early motherboard BIOSes were also unable to cope with the higher speed, higher density memory kits. Therefore it is important to make sure that all BIOSes are up to date when buying the expensive memory sets.

DDR4 Module Comparison
  SKU Kit Size Kit Speed Sub-Timings Voltage PI
Corsair CMD16GX4M4B3200C16 16 GB (4x4) DDR4-3200 16-18-18 2T 1.35 V 200
G.Skill F4-3000C15Q-16GRR 16 GB (4x4) DDR4-3000 15-15-15 2T 1.35 V 200
G.Skill F4-2800C16Q-16GRK 16 GB (4x4) DDR4-2800 16-16-16 2T 1.20 V 175
G.Skill F4-2666C15Q-16GRR 16 GB (4x4) DDR4-2666 15-15-15 2T 1.20 V 177
Crucial BLS8G4D240FSA 16 GB (4x4) DDR4-2400 16-16-16 2T 1.20 V 150
G.Skill F4-2133C15Q-16GRR 16 GB (4x4) DDR4-2133 15-15-15 2T 1.20 V 142
ADATA AX4U2400W8G16-QRZ 64GB (8x8) DDR4-2400 16-16-16 2T 1.20 V 150
Corsair CMV8GX4M1A2133C15 64GB (8x8) DDR4-2133 15-15-15 2T 1.20 V 142
 

The memory in this test is as follows, starting with the 4x4GB kits and fastest/most expensive:

DDR4-3200 16-18-18 2T 4x4 GB 1.35 V Corsair CMD16GX4M4B3200C16, PI of 200
$746 on Amazon
$685 on Newegg

DDR4-3000 15-15-15 2T 4x4 GB 1.35 V G.Skill F4-3000C15Q-16GRR, PI of 200
$436 on Amazon
$300 on Newegg

DDR4-2800 16-16-16 2T 4x4 GB 1.2 V G.Skill F4-2800C16Q-16GRK, PI of 175
$305 on Amazon
$270 on Newegg

DDR4-2666 15-15-15 2T 4x4 GB 1.2 V G.Skill F4-2666C15Q-16GRR, PI of 177
$290 on Amazon
$250 on Newegg

DDR4-2400 16-16-16 2T 4x4 GB 1.2 V Crucial BLS8G4D240FSA.16FAD, PI of 150
$180 on Amazon

DDR4-2133 15-15-15 2T 4x4 GB 1.2 V G.Skill F4-2133C15Q-16GRR, PI of 142
$315 Amazon
$250 Newegg

For good measure, we also have the following kits for testing:

DDR4-2400 16-16-16 2T 4x8 GB and 8x8 GB 1.2 V ADATA AX4U2400W8G16-QRZ, PI of 150
$400 for 4x8GB

DDR4-2133 15-15-15 2T 4x8 GB and 8x8GB 1.2 V Corsair CMV8GX4M1A2133C15-ESM, PI of 142
$120 per module

We also have more kits from Crucial, Corsair, G.Skill and KLEVV incoming for when we tackle individual reviews. The purpose of this scaling piece is merely to demonstrate the general effect of speed across the modules currently on the market. As mentioned, some of those kits with a CL of less than 15 look interesting, so I will have to give Mushkin a call or get a contact at Kingston.

Test Setup

Test Setup
Processor Intel Core i7-5960X ES, 8C/16T overclocked to 4.0 GHz
Motherboards ASUS X99 Deluxe
Cooling Cooler Master Nepton 140XL
Power Supply OCZ 1250W Gold ZX Series
Memory Corsair DDR4-3200 16-18-18 4x4GB, CMD16GX4M4B3200C16
G.Skill DDR4-3000 15-15-15 4x4GB, F4-3000C15Q-16GRR
G.Skill DDR4-2800 16-16-16 4x4GB, F4-2800C16Q-16GRK
G.Skill DDR4-2666 15-15-15 4x4GB, F4-2666C15Q-16GRR
Crucial DDR4-2400 16-16-16 4x4GB, BLS8G4D240FSA
G.Skill DDR4-2133 15-15-15 4x4GB, F4-2133C15Q-16GRR
ADATA DDR4-2400 16-16-16 8x8GB, AX4U2400W8G16-QRZ
Corsair DDR4-2133 15-15-15 8x8GB, CMV8GX4M1A2133C15-ESM
Memory Settings XMP
Video Cards MSI GTX 770 Lightning 2GB (1150/1202 Boost)
Hard Drive OCZ Vertex 3 256GB
Case Open Test Bed
Operating System Windows 7 64-bit SP1
DDR4 Haswell-E Scaling Review Enabling XMP
Comments Locked

120 Comments

View All Comments

  • wyewye - Sunday, February 8, 2015 - link

    Extremely weak review.

    Ian, is this your first memory review?
    Everyone knows in the real world apps the difference is small. Whats the point to show a gazilion of charts with 1% differences. You had way more random noise from the tests errors, those numbers are meaningless.
    For memory, the syntetic tests is the only way.

    Thumbs down, bring back Anand for decent reviews.
  • wyewye - Sunday, February 8, 2015 - link

    @Ian
    ProTip: when the differences are small and you get obviously wrong results like 2800@cl14 slower than 2133@cl16, run 10 or 20 tests, eliminate spikes and compute the median.
  • wyewye - Sunday, February 8, 2015 - link

    Ian stop being sloppy and do a better job next time!
  • Oxford Guy - Sunday, February 8, 2015 - link

    "Moving from a standard DDR3-2133 C11 kit to DDR4-2133 C15, just by looking at the numbers, feels like a downgrade despite what the rest of the system is."

    Sure... let's just ignore the C10 and C9 DDR3 that's available to make DDR4 look better?
  • eanazag - Monday, February 9, 2015 - link

    Why not post some RAM disk numbers?

    What I saw in the article is that the cheapest, high capacity made the most sense for my dollar.
  • SFP1977 - Tuesday, February 10, 2015 - link

    Am I missing something, or how did they over come the fact that their 2011 test processor has 4 memory lanes while that 1150 processor has only 2??
  • deanp0219 - Wednesday, February 11, 2015 - link

    Great article, but in fairness, you're comparing the first run of DDR4 modules against very well developed and evolved DDR3 modules. When DDR3 was first released, I'll bet some of the high-end DDR2 modules available at the time matched up with them fairly well. We'll have to see where DDR4 technology goes from here. Again, great read though. Totally not a reflection on the article -- nothing you can do about the state of the tech. Made me feel better about my DDR3-2133 machine!
  • MattMe - Friday, July 10, 2015 - link

    Am I right in thinking that the benefits of DDR4 outside of power consumption could well be in scenarios where integrated graphics are being utilised?

    The additional channels and clock speeds are more likely to have an effect there than an external GPU, I would assume. But we're still yet to see any DDR4L in the consumer market (as far as I'm aware), it's most beneficial area.

    Seeing some benchmarks including integrated graphics would be very interesting, especially in smaller, lower powered systems like a NUC or similar.
  • LorneK - Monday, October 5, 2015 - link

    My gripe with Cinebench as a "professional" test is that aside from tracing rays, it in no way resembles the kind of rendering that an actual professional would be doing.

    There's hardly any geometry, hardly any textures, no displacement, no advanced lighting models, etc.

    So yeah, DDR4 makes barely any impact in Cinebench, but I have to wonder how much of that is due to Cinebench requiring almost nothing from RAM in general.

    Someone needs to come along and make a truly useful rendering benchmark. A complex scene with millions of polygons, gigs of textures, global illumination, glossy reflections, the works basically.

    Only then can we actually know what various aspects of a machine's hardware are affecting.

    An amazing SSD would reduce initial scene spool up time. Fast single thread performance would also increase render start times. Beefy RAM configs would be better at feeding the CPUs the multiple GBs needed to do the job. And the render tiles would take long enough to complete that a 72 thread Xeon box isn't wasting half its resources simply moving from tile to tile and rendering microscopic regions.
  • Zerung - Tuesday, February 9, 2016 - link

    My Asus Mobo notes the following:
    'Due to Intel® chipset limitation, DDR4 2133 MHz and higher memory modules on XMP mode will run at the maximum transfer rate of DDR4 2133 Mhz'. Does this mean that running the DDR4 3400 CL16 may not give me the latency below 10?
    Thanks

Log in

Don't have an account? Sign up now