Our smartphone benchmarks are centered around browser-based tests, and this is one area that really shows how far behind Internet Explorer 10 Mobile is relative to the mobile versions of Safari and Chrome. The other part of this is looking at Krait 200 at 1GHz versus the higher-clocked parts we see in the more expensive Windows Phones, which allows us to look at relative performance on the same software platform.

SunSpider Javascript Benchmark 0.9.1—Stock Browser

Google Octane Benchmark v1

Mozilla Kraken Benchmark Sunspider performance is actually quite good, especially compared to other Krait 200-based devices like the One X and AT&T Galaxy S3. Where it falls off is in everything else—Kraken and Octane performance is just horrendous in comparison to the modern smartphone platforms. I didn’t think it was actually possible to see numbers that high in the Kraken benchmark until I ran it a half-dozen times on my 521 review unit as well as a friend’s Lumia 920. Microsoft clearly optimized for Sunspider, as we’ve seen over the years, and while that lets them stay competitive in that one benchmark, it doesn’t really mean anything as far as having decent or even acceptable browser performance. It’s just sad.

Between the 920 (MSM8960, so dual-core Krait 200 @ 1.5GHz and Adreno 225) and the 521, there’s a definite performance delta. Obviously, this comes through in roughly 50% faster benchmark numbers across the board, but in day to day use, it mostly makes itself felt in slower application loading and multitasking/task switching, which is also related to having just 512MB RAM instead of the 1GB of the 920. Multitasking in Windows Phone has never really sat well with me, because it’s not really multitasking in the traditional sense—the need to completely close and rehydrate tasks makes resuming applications exceedingly slow. Microsoft has always seemed to have an issue with app load times with ARM devices—this has been true since day one with Windows Phone, and is a problem with Windows RT tablets too—so the resulting combination can really kill any desire to run more than one task on your phone at a time.

I couldn’t run GFXBench (DXBenchmark) on the 521 because it didn’t meet the 1GB RAM requirement necessary to run the benchmark. I actually wasn’t even aware that GFXBench had such a requirement in place until I tried to install it on the 521. In the grand scheme of things, I suppose it doesn’t matter too much—we’re pretty familiar with Adreno 305 by now, and it seems to be the go-to GPU for Qualcomm’s new series of dual-core Krait 200 SoCs. In a platform that deemphasizes silicon performance in the end user experience as much as Windows Phone seems to, I’m not sure that the performance delta between this and Adreno 225 makes too much of a difference, particularly with a far lower-res screen. We’re starting to see the more 3D intensive games require 1GB of memory to run, so this isn’t the device for the hardcore gamers. It does fine with the typical slate of casual games though—Fruit Ninja, Angry Birds, and the like.

The air interface is probably something you could point to and say is a bit lacking—in this day and age, dual carrier HSPA+ is almost an expectation on T-Mobile and international non-LTE devices. But honestly, you don’t end up missing it much. T-Mobile’s HSPA+ network is quite robust both in Seattle as well as in Silicon Valley, the two places I spent time testing the 521, so 10+ Mb/s was basically the norm.

I couldn’t figure out how to get the Windows Phone SpeedTest app to email a CSV of the test results, so no graphs with binned speed tests like we have on Android reviews. We’ve had a lot of experience with T-Mobile’s HSPA+ network over the years though, and it tends to be very good in most metropolitan areas. Obviously, there’s a significant jump in speed between HSPA+ and LTE, but the real-world difference between single and dual-carrier HSPA+, at least on T-Mobile, seems to be much harder to discern perceptively. The lack of DC-HSPA+ is still a bit of a disappointment, but I’m not nearly as cut up over it as I was when I saw it on the specsheet.

Battery Life The IPS Display
Comments Locked

116 Comments

View All Comments

  • just2btecky - Thursday, August 8, 2013 - link

    FYI, people who buy this phone care less about a grid of icons, or phfart apps. The WP OS is easier to use than the iPhone, not to mention the iClones. What you gain on WP8 over IOS is fluidity and more modern UI, and very very easy to navigate through. Have you even used a WP UI? I doubt it!
  • d0nk3y - Thursday, August 8, 2013 - link

    Yes - that's right - iOS is just a 'grid of icons' and 'phfart apps' - apparently you haven't used iOS either.

    Oh, and you forgot the pointless 'crap Maps' jibe as well..
  • amdwilliam1985 - Thursday, August 8, 2013 - link

    yeah, I've used Lumia 920, didn't like it, don't even have a pull down notification.

    Show the camera phone to my gf, she hated it, why you ask? wp8 does not let you customize a wallpaper, lol. This is worst than iphone in terms of customization.
  • althaz - Thursday, August 8, 2013 - link

    You are more than welcome to prefer iOS (although I think that makes you crazy) or Android (a perfectly valid opinion), but to say WP is less customizable than iOS is actually pure idiocy. It's less customisable in most ways than Android, but MUCH more customisable than iOS in almost all ways. The sole exception is that you can't add a wallpaper (it would look shit, but I agree that it should be an option anyway).

    The lack of notification centre is being fixed in the next update, btw (but should have been there at launch).
  • Myrandex - Friday, August 9, 2013 - link

    There have been other areas of criticism compared to customization between an iOS device and WP device. The lack of the ability to make folders on the desktop is one that people are asking for (and Samsung just delivered this week for their WP devices, but I would love to see this baked into the OS). Native VPN support isn't there, but that is supposedly coming. And the wallpaper thing.

    There are advantages as well though so it isn't all a one way slam against WP. I've used all three platforms extensively (although today I currently only use Android and WP as my iPhone that I had for years was a company phone and when I switched positions it was left behind), there are plusses and minuses to all of them.
  • npoe1 - Saturday, August 10, 2013 - link

    I might be an exception but notification center is not a great feature to me. The live titles have worked great for me but I don’t really use more than 3 or 5 apps that I really need to have tight grip of what is happening.

    I missed the Wallpaper the first week, but honestly it was me trying to hang in Windows XP/Vista/7. The lock screen does the job and does an awesome job in my opinion. Also, in WP I don’t have to worry about processors and those kind of specs since basically everything runs great.
  • lmcd - Wednesday, August 14, 2013 - link

    Should have Windows 8-like wallpapers. That'd be nice without a doubt.

    Why isn't WP a Windows 8 / RT clone with a Skype driver for interaction with the cellular network?

    Pure idiocy in my mind.
  • Spunjji - Thursday, August 8, 2013 - link

    Except several hundred dollars extra in your pocket at the end of the day...
  • Myrandex - Thursday, August 8, 2013 - link

    They gain a variety of hardware choices and sizes to suite needs, potentially better cameras, STANDARD F'IN power / USB cables (will not support any companies proprietary BS), wireless charging, large bright screens visible in sunlight, expandable memory, live tiles, etc.

    iPhones have a place and I've recommended them to people before, and I do agree that they are easy to use but have a lot of features and settings, but they aren't perfect.
  • davepermen - Friday, August 23, 2013 - link

    until you used WP and realize the many points where ios is lacking in 'ease of use', and the feature lack is mostly not relevant.

Log in

Don't have an account? Sign up now