Benchmarking Performance: CPU Office Tests

The office programs we use for benchmarking aren't specific programs per-se, but industry standard tests that hold weight with professionals. The goal of these tests is to use an array of software and techniques that a typical office user might encounter, such as video conferencing, document editing, architectural modelling, and so on and so forth.

All of our benchmark results can also be found in our benchmark engine, Bench.

Chromium Compile (v56)

Our new compilation test uses Windows 10 Pro, VS Community 2015.3 with the Win10 SDK to combile a nightly build of Chromium. We've fixed the test for a build in late March 2017, and we run a fresh full compile in our test. Compilation is the typical example given of a variable threaded workload - some of the compile and linking is linear, whereas other parts are multithreaded.

Office: Chromium Compile (v56)

Our popular Chrome Compile test gives a good showing for the Intel CPUs, however the higher-powered Core i9 processors perform a lot better here - up to 50% in fact. Part of this is down to memory; the DDR4-2666 C19 memory is slower than the DDR4-2666 C16 used in our Core i9 reviews. However, there might also be a case for power draw - the BIOS defaults for the Core i9 processors allow for a lot more power consumption, which the Xeon W processors might not be able to tap in to. It is worth noting that the W-2155 wins against the W-2195, showing that in this test frequency matters as much as cores.

SYSmark 2014 SE: link

SYSmark is developed by Bapco, a consortium of industry CPU companies. The goal of SYSmark is to take stripped down versions of popular software, such as Photoshop and Onenote, and measure how long it takes to process certain tasks within that software. The end result is a score for each of the three segments (Office, Media, Data) as well as an overall score. Here a reference system (Core i3-6100, 4GB DDR3, 256GB SSD, Integrated HD 530 graphics) is used to provide a baseline score of 1000 in each test.

A note on context for these numbers. AMD left Bapco in the last two years, due to differences of opinion on how the benchmarking suites were chosen and AMD believed the tests are angled towards Intel processors and had optimizations to show bigger differences than what AMD felt was present. The following benchmarks are provided as data, but the conflict of opinion between the two companies on the validity of the benchmark is provided as context for the following numbers.

Office: SYSMark 2014 SE (Overall)

PCMark 10: link

PCMark 10 is the latest all-in-one office-related performance tool that combines a number of tests for low-to-mid office workloads, including some gaming, but focusing on aspects like document manipulation, response, and video conferencing.

Office: PCMark10-1 Essential Set Score

Office: PCMark10-2 Productivity Set Score

Office: PCMark10-3 Creation Set Score

Office: PCMark10-4 Physics Score

In the Physics score, the W-2195 takes a commanding lead, however the W-2155 is not far behind, offering a better performance per dollar metric. Both are outclassed by the Threadripper 1950X in this test, however.  In fact, the only test where Xeon W truly wins is in the Creation test.

GeekBench4: link

GB4 is a popular tool in benchmarking, with most users liking its cross-platform functionality. Due to requests, we are including the data in our reviews. Our benchmark database has a more detailed breakdown of the sub-sections in the test.

Office: Geekbench 4 - Single Threaded Score (Overall)Office: Geekbench 4 - MultiThreaded Score (Overall)

GeekBench 4 is still a newer benchmark in our test suite, hence the lack of comparative results.

PCMark8: link

Despite originally coming out in 2008/2009, Futuremark has maintained PCMark8 to remain relevant in 2017. On the scale of complicated tasks, PCMark focuses more on the low-to-mid range of professional workloads, making it a good indicator for what people consider 'office' work. We run the benchmark from the commandline in 'conventional' mode, meaning C++ over OpenCL, to remove the graphics card from the equation and focus purely on the CPU. PCMark8 offers Home, Work and Creative workloads, with some software tests shared and others unique to each benchmark set.

Office: PCMark8 Work (non-OpenCL)Office: PCMark8 Home (non-OpenCL)Office: PCMark8 Creative (non-OpenCL)

[words]

 

Test Setup and Power Consumption Benchmarking Performance: CPU System Tests
Comments Locked

74 Comments

View All Comments

  • Ian Cutress - Monday, July 30, 2018 - link

    If we ever get a Xeon Scalable system up and running for proper benchmarking, I'll run through some tests.
  • JoJ - Saturday, August 4, 2018 - link

    Hi Ian,

    I beg you to consider the futility of approaching HPE, to obtain a Z station and 56 Scalable cores, max RAM etc, may not may be wholly as anticipated.

    I have a very high profile media production job coming, that could warrant a room of fully loaded such machines. Truly high profile. I have been always able to establish nearly immediate rapport with the marketing folk who are not apparently thought about by the UK online tech media, as warmly as I think it fair, but then I deal in printed worlds of very controlled readerships, and possibly by reflex alone I'm treated like I have more to say than I often do. But approaching the twenty five years mark, I probably ran out of lines some nineteen years ago anyway...

    I care about hurling around heavily laden InDesign files, often without any media placeholders to include 409MB Hassleblad captures straight from the photographer. This project is going to be filled with custom adverts not run in any other media ever. (It took longer to agree copy for Rolls Royce than to sell the deal, in our first encounter with this project. VWAG owned both marques including Bentley, then.) Advertisers may visit, our job to produce for them their first display copy ever, because of interest from services who are in the word of mouth referral ecosystem this publication represents. We are effectively building a advertising studio, to accommodate the needs presented by, eg a long established security company, beyond public profile not by necessity or plan but rather not seeing the circle squared to deliver satisfactory result, without establishing unwanted capacity or staffing. So founder directors shall descend, for interview and portrait, the deal being approved by them signing a proof of the pages, in person, ideally we are able to complete 60% of the interview and layout remotely in advance.

    I want to suggest to you that HPE could genuinely be intrigued by the client base of our project, and want to be exposed to them... mostly boutique banks and funds. A typical user is running a dozen Bloomberg Professional windows, Excel, with live updates and a lot of libraries for giving cell results, will have a terabyte or so of core textual references, between academic papers, email threads, online discussion (usually scraped) , and the job is to fill very specialist magazines with content and advertisers who don't play in the spray and pray brand game, but care everything about how they're found by a prospective new customer. So atop the trappings of a financial trader's desktop, will be layered Word, sure, but a TeX compositor, Visual studio, InDesign, PS...WHY? Because if we can get the message right, we can trade quickly to fill a matching campaign of the same redundancy as big ad buyers get, at even sharper prices. They come for creative, stay for flow execution.

    It's realistic, even commonplace, for a Xeon Scalable workstation to find itself in front of board member powers, in this way.

    Looking at the decisive commitment required to purchase current generation high end workstations, I assume that HPE, Dell et.al. just lean on their direct sales forces.

    but strip away our Corporate veneer, and we're indistinguishable from any of your readers.

    Individual buyers of workstation class computers, commonly inhabit the front line trenches of high end media production. London seethes with freelancer artists, driven by insufficient investment by employers, to fly solo simply to stay current with the tools and turnaround of their art. I can't win any argument about how far from the public imagination of the game, is the typical MB Pro user, sat elegantly in a WeWork chair, I thought my first sight of the Barbican WeWork office, was a film set... (whereas we're actually building a film set where to conduct our FOH business, because I can't vouch for the appearance of our actual digs. (Mr CIO left of his own accord, incapable of tolerating our disinterested views of fancy workspaces... the fact that our dev team is 80% founder level partner, actually never came into play, but the non attendance at his"corporate development" meetings, was protest against the idea of competing for hires with luxuries. Pity, in this one respect alone, the one character aspect we didn't believe necessary to investigate in interview, so patent is our third world architectural infrastructure, relations truly soured only because the guy was so good in every way otherwise. We just couldn't please with such capital commitments, not looking at the impending A grade glut just completing in the City. Such dangerous words; "absolutely, in the future, if you take us there, we will want a statement head office for sales etc". Just not on any immediate plans..

    sorry, Ian, I am avoiding saying that I think I certainly could sell a HPE on the facts we know very well, where they'll be getting sales, in this sector at least, more from physical exposure to buyers and influencers, directly demonstrated the new generation capability by entirely non conveniently situated independent professionals and outside service companies, but absolutely nothing to look at in the kind of performance review I can't really understand is so homogeneous online, because this sort of evaluation hardly relates to the real use at all.

    I am adamant that the entire presentation of high end desktop bixes is hostile and increasingly damaging to sales of performance workstations to corporate office buyers of all kinds.

    Wall to wall gamer imagery has diluted the public perception of utilitarian power of computers beyond homeopathic insignificance.

    Nothing, not a single word for twenty years- it seems to me - has conveyed any part of this crucial message: "With this new Intel computer, and the latest developments in the most advanced quantitative tools for generations, I WHOOP MY COMPETITIONS REAR!'

    By all means, running a renderer matters in the industry that we inhabit. But the reason why we'll shell out for a 56 core beast, is so we can quickly previs a scene, while still working through the latest circulation data dump for the 200,000 or so publications we trade advertising on. Most days, we're rendering visuals of the data we don't want to take our concentration aeay from, again the reason why we're looking at the new HPE Z station Scalable workstations.

    i have to be distracted but I'll conclude with guaranteed brevity upon my short return. There's plenty of angles here to get a vendor to cough up a couple of fully loaded machines for you, and I am entirely serious I'll invest the necessary time to get you a shot if you think I'm not batshii crazy. bfn
  • Elstar - Monday, July 30, 2018 - link

    To be fair, the top end Core X and Xeon W have different TDP values.
  • HStewart - Monday, July 30, 2018 - link

    So does TDP values make bigger impact than actual Frequency - on same chip of course.
  • BurntMyBacon - Tuesday, July 31, 2018 - link

    It is more that TDP and frequency can no longer be separated. If you completely ignore TDP and fix the frequencies to their maximum, then TDP only matters in as much as you have the proper cooling solution to manage it. However, the actual running frequency of Intel's processors are tied into processor temperature, power, number of active cores, etc. On the same chip, a larger TDP means the processor can spend more time at higher frequencies or have more cores active at the same frequency.
  • mode_13h - Monday, July 30, 2018 - link

    The difference relative to X-series is probably due to thermal throttling due to dual AVX-512 and heat buildup under the non-soldered IHS.
  • HStewart - Monday, July 30, 2018 - link

    That would also be interesting test - I believe AVX-512 can be turned off in bios - not sure since I don't have one.
  • JlHADJOE - Tuesday, July 31, 2018 - link

    Lack of Turbo Boost 3.0 maybe?
  • stanleyipkiss - Monday, July 30, 2018 - link

    Besides the VM situation on Threadripper, why would anyone spend $2500+ for this?
  • duploxxx - Monday, July 30, 2018 - link

    what VM situation?

Log in

Don't have an account? Sign up now