Consumer Reports’ final iPhone X test results: top-scoring camera and display but also some flaws

Consumer Reports:

The iPhone X is an innovative device with a fantastic camera and beautiful display, but other phones are tougher and can operate longer on a charge.

Overall, the iPhone X—as in 10, not the letter that follows W—easily made Consumer Reports’ recommended list and broke into the extremely tight list of top 10 rated phones, where all the devices are separated by only two points on our 100-point scale.

It was edged out by Apple’s less-expensive iPhone 8, starting at $700, and 8 Plus, starting at $800, which both proved hardier in a test designed to reproduce the drops and fumbles that can cause cracked screens and other damage.

Many of us are justifiably skeptical about Consumer Reports and their tests of Apple products in general but many others rely on them for help in making purchase decisions.

  • komocode

    “Consumer Reports uses a robotic finger programmed to put the phone through a range of tasks designed to simulate a consumer’s average day.”

    and then

    “We run all smartphone battery tests with the display set to 100 percent brightness.”

    who has 100% brightness on 24/7 on an average day? either test everything at 100% (cpu/gpu/speakers/cellular/etc…) or try to emulate the consumer use as close as possible. mixing them makes 0 sense to the average user.

    • “who has 100% brightness on 24/7 on an average day?” My (new!) wife until I taught/showed her how to change it.

      • komocode

        odd! i thought auto-brightness was on by default?

        • It is. But she had managed to change it somehow. 🙂

      • Janak Parekh

        If the new refers to wife and not the phone, congratulations!

        Doesn’t iPhone X warn you about turning off auto-brightness? It’s amazing people just click through that.

        • Both are new and I’ll accept congratulations for both or either. 🙂

          I don’t know if the iPhone X does but she has a 6 Plus. I never saw those warnings when I used it.

          • Janak Parekh

            Hmm, that’s why I was confused—the article is about the iPhone X, which as an OLED screen and an associated warning mechanism around turning off auto-brightness as it can affect OLED life.

            (OOC, was the 6+ new? I assumed that, since it’s no longer sold by Apple, at this point you’d only get used units.)

          • It was/is a hand me down. My old one.

    • Herding_sheep

      I’m also pretty skeptical of their runtimes. First of all, the testing conditions are not typical as mentioned, but also if they truly ran the device at full brightness then there’s no way they’d be getting those kinds of runtimes. For ALL devices.

      The same bizarre numbers were reported with the MBP with TB controversy they started last year as well. Everyone said the same thing, that their run times are completely bizarre and not reproducible under ANY condition, let alone max brightness.