I'll go ahead and end the suspense for you now: Android upgrades are a big, hot mess — and the situation with Oreo is the worst we've seen to date.
It's kind of embarrassing, actually. But it's important. And that's why I take the time to track manufacturers' performance in this area so closely year after year — because software matters. It affects your experience more significantly on a day-to-day basis over the life of a modern mobile device than any other feature or element. And yet, it tends to get the least amount of attention.
To wit: Over the coming days, Samsung and other Android device-makers will take the stage to show off their latest and greatest wares. Their new phone models be plenty impressive, no doubt — gorgeously designed works of gadget art. We'll hear about every ever-shrinking bezel, every fresh feat of engineering, every new "smart" feature that sounds wildly impressive (but is bound to mostly fall flat in reality).
You know what we won't hear a peep about, though? The manufacturers' commitments — or lack thereof — to supporting and updating all those smartphones after you plunk down your hard-earned cash to buy 'em. Most Android device-makers don't like to draw attention to that area, and for good reason.
Guess what, though? Smartphones are expensive products that most of us own for two or even three years. And if you buy a phone from a manufacturer that doesn't make upgrades a priority, your device is going to be perpetually out of date and behind the curve in terms of both technological progressions and platform security.
You may not be able to force a manufacturer to make timely and reliable ongoing upgrades a priority, but you can arm yourself with knowledge about how different manufacturers tend to approach post-sales software support — and then make an educated decision about what sort of upgrade experience you want (or are willing to accept) ahead of your next phone purchase.
Now that we're six full months past the launch of the most recent major Android release, Android 8.0 Oreo, it's time to step back and look at who's making upgrades a priority and who's treating them as an afterthought.
Brace yourselves, gang. This one's rough.
(Want the full nitty-gritty on how these grades were calculated? You can find a detailed breakdown of the formula and every element taken into account at the very end of this article.)
- Length of time for upgrade to reach current flagship: 9 days (60/60 points)
- Length of time for upgrade to reach previous-gen flagship: 18 days (29/30 points)
- Communication: Mediocre (5/10 points)
With its Pixel line, Google officially became a full-fledged Android phone manufacturer. But even before, with its Nexus devices, it played the same role as far as updates go — acting as the sole provider of all rollouts and software-related matters.
In this report card, we see one final split of those two programs. At the time of Oreo's debut, Google's first-gen Pixel was its current flagship and its Nexus 6P and 5X were its previous leading phones. (The newer Pixel 2 didn't go on sale until October, well after Oreo's debut and with Android 8.0 in place from the get-go, so it isn't relevant to this analysis.)
The results for that lineup are mostly good, though not perfect: The rollout of Oreo to original Pixel owners started on August 29, nine days after the software's debut. That's a bit behind Google's typical immediate rollout window, but it's still perfectly reasonable — and still well within the one-to-14-day range for a top-of-line mark in these scoring standards.
Nexus 6P and 5X owners waited a bit longer, meanwhile, with the first confirmed general rollouts (not beta-tester-related) starting on September 7 and then spreading out slowly to more users over the subsequent weeks.
On that note, we have to mention that Google, rather infamously, rolls out its updates "in waves" — which means some people end up waiting days or even weeks longer than others to receive the software. That's a deliberate process designed to keep unexpected bugs or issues from reaching large groups of users before they can be addressed. It can understandably be a source of frustration for eager device-owners in the later parts of the rollouts, but for the purposes of this analysis, it's the start of the rollout that counts.
The real issue with Google's update performance — and it's one we see pretty consistently over time — is that the company's communication could stand to be better. Aside from its initial August 21 announcement that "carrier testing" was underway for all devices and rollouts would start "soon" — and then an equally vague August 31 tweet that rollouts had begun for "Nexus and Pixel" devices, in general — Google didn't provide much else in terms of official info about its process. That means users who were waiting were essentially in the dark, sometimes for several weeks, with no sign of the upgrade and no idea what was going on or how long the wait might be. A simple status report page with details about the state of the rollout for different device variations and regions would go a long way.
Between that less-than-stellar communication and the frustrations that sometimes result from its staged rollout process, Google's Android devices are by no means flawless when it comes to OS upgrades. Even so, they stand in a league of their own — without question the most reliable way to receive ongoing updates in a timely, if not always absolutely immediate, manner.
[Follow on Twitter: JR Raphael | Android Intelligence]
OnePlus
- Length of time for upgrade to reach current flagship: 138 days (41/60 points)
- Length of time for upgrade to reach previous-gen flagship: 91 days (24/30 points)
- Communication: Poor (0/10 points)
No, you didn't accidentally skip over a section: The grades on this year's report card actually go from a single "A" directly to a "D." So while second place is usually something worth celebrating, I don't know that there are any real bragging rights to be had here.
OnePlus — which is included in this analysis for the second year now, given its popularity among Android enthusiasts and its insistence that its devices are flagship caliber (and then some) — strangely provided Oreo to its previous-gen flagships, the OnePlus 3 and 3T, ahead of its current-gen flagship, the OnePlus 5. The former saw the software starting on November 19, nearly three months after Oreo's arrival. The rollout for the latter started in earnest on January 5, about four-and-a-half months after Oreo's release.
(OnePlus technically started the 5's rollout in late December but then quickly pulled the update due to a bug and didn't restart it for a couple of weeks. The OnePlus 5T, meanwhile, didn't come out until November — well after Oreo's launch, even though it still inexplicably shipped with Nougat in place — hence its exclusion from this analysis.)
OnePlus didn't do much in the way of communication with customers, meanwhile — no official estimates, no promises, no meaningful updates or ETAs along the way. The only real communication was an announcement in the company's forums that a rollout was beginning. So if you owned a OnePlus device, all you could do was wait blindly and hope the upgrade might show up on your phone soon.
All in all, not a spectacular effort — despite its depressing second-place ranking in this class of underperformers.
HTC
- Length of time for upgrade to reach current flagship: 99 days (47/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (2/10 points)
HTC's fall from grace picks up serious pace this year, with a dismal 49% failing score. This continues the downward trend the company's been experiencing since last year's Nougat rollout.
HTC served up Oreo to the unlocked version of its current-gen U11 flagship starting on November 27, just over three months after the software's arrival — not cheer-worthy, by any stretch of the imagination, but not atrocious, either.
It's the previous-gen HTC 10 that really sunk the ship: Despite announcements suggesting Oreo rollouts had begun for the unlocked 10 in early January and then again in early February — and a separate announcement indicating Oreo was on its way to the Sprint model of the phone in mid-February — I've yet to find a single U.S.-based HTC 10 owner who has actually received the upgrade.
Reddit and other forums are filled with pages upon pages of frustrated 10 owners asking what's going on. HTC has remained curiously silent, with its typically vocal product VP sending nary a tweet since his now-empty-seeming February 11 proclamation. The official HTC Twitter account, meanwhile, has been sending only boilerplate non-responses to agitated inquiries.
[Update (2/23/18): HTC started its Oreo rollout to unlocked HTC 10 owners in the U.S. late in the evening on February 22, the same day this story was published. The company tells me the rollout began for owners of the Sprint-connected model at the same time. That's outside of the six-month window this analysis considers, so it doesn't do anything to change the grade — and even if the rollout had started as much as three weeks ago, the most it would have done was bumped HTC's score up to a "D+" — but given the close timing and the unusual nature of this situation, I thought it warranted a mention.]
On the subject of communication, HTC's once-exemplary "Software Updates" page — where the company used to post detailed information about the update status for every model and variant in its catalog — has basically been abandoned since last summer. The company gets a couple of communication points for at least releasing a general plan at the time of Oreo's release, with info about which phones would be upgraded (and a vague "Q4" timeframe for the U11's rollout, which it did meet), but all in all, things have really moved in the wrong direction.
For a company that once worked so hard to make upgrades — and, more broadly, customers — a priority, that's sure a shame (if not an entirely surprising transition) to see.
Motorola (Lenovo)
- Length of time for upgrade to reach current flagship: 124 days (43/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (2/10 points)
One thing's for sure: This ain't the Moto we used to know. The now-Lenovo-owned Motorola disappointed once again with a four-month delay for getting Oreo onto its current Moto Z2 Force flagship (starting with the Verizon version of the phone in late December) and then, critically, for failing entirely to get Oreo onto its previous-gen Moto Z flagship at all within these first six months of the software's availability.
Like HTC, the company gets a couple of communication points for at least putting out a vague plan of which devices it intended to upgrade shortly after Oreo's announcement. And Moto does still maintain a software update page where you can search for the update status of any make and model.
The problem is that the page is devoid of any real details. Look up the Moto Z, for instance — even the unlocked model — and all you'll see is: "This device will be upgraded to the Android 8 (Oreo) release of Android, pending partner support." The same seems to apply to most every device on the page. Having an information page with no actual information almost seems more insulting to customers than having no information page at all.
NEXT PAGE: A new level of failing with LG and Samsung (plus a glimmer of hope with Sony and Nokia)
LG
- Length of time for upgrade to reach current flagship: Still waiting (0/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (0/10 points)
What's there to say about a company that doesn't even seem to be trying? LG has yet to deliver Oreo to its current-gen G6 or its previous-gen G5. It's made no real effort to communicate anything with its customers about its plans for either product.
It's ultimately a black hole: If you buy a phone from LG, you're accepting the fact that you'll be waiting in the dark — likely for a very long time — to see if or when you'll ever get any future updates.
Samsung
- Length of time for upgrade to reach current flagship: Still waiting (0/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (0/10 points)
And here, at the very bottom of our report card on upgrade performance, is the top-selling manufacturer of Android devices. Samsung has always done poorly with upgrade deliveries, but this year marks a new low — with not a single non-beta rollout to any of its current or previous-gen (S-series or Note series) devices in the U.S. And, as usual, there's been no official communication whatsoever with customers about its progress or what can be expected.
Just today, unofficial reports suggest an S8 Oreo rollout has started anew in Germany, but that's neither here nor there (in either timing or scope) for the purposes of this analysis. For the largest and most profitable Android manufacturer, this isn't a matter of resources. We can talk about fixing bugs and getting things right all we want, but the cold, hard truth is that Samsung has had access to Oreo since March — just like everyone else — and has had the software's final build in hand since August.
Particularly for a company of Samsung's size and with its immense financial and engineering resources, not being able to deliver updates to customers after all those months is about one thing and one thing only: priorities.
Sony and Nokia: Two quick footnotes
This report card focuses on the companies most relevant to the U.S. flagship market, as explained in the methodology section below, but I wanted to quickly call out a couple other notable Android players.
Sony, which has become increasingly irrelevant in the U.S. market over time, managed to get Oreo onto its current-gen Xperia XZ flagship in late October — just two months after Oreo's release. It then took about three months to send the software to its previous-gen flagship, the Xperia XZ. Its communication efforts were minimal, with a vague list of devices to be updated early on and not much beyond that. All considered, if we were including it in this analysis, it'd have earned a solid "C" score — nothing particularly awe-inspiring, by any means, but at least something semi-respectable (especially in a relative sense, since that'd give it a higher score than any manufacturer outside of Google this year).
And then there's Nokia — a newcomer to the Android game just as of this past year. The company's sole flagship phone thus far, the Nokia 8, wasn't released in the U.S. But I thought it was worth noting, regardless, that Nokia delivered Android 8.0 to the phone in late November, three months after the software's arrival, and then bumped the device up to the newer Android 8.1 version of Oreo earlier this month.
That's not enough data to base even a theoretical grade on, but it is enough to call it a promising start — especially given Nokia's effort to make the notion that its devices are always "up to date" and secure" a core part of its marketing message.
Putting it all in perspective
There's not much to say here that I haven't said before, time and time again, so I'll look to my past words for inspiration: We can — and should — do better.
But you know what? At the end of the day, that's not up to us. You and I can't control what manufacturers do or how much of a priority they make timely and ongoing software support. All we can do is educate ourselves about their practices, decide how much that matters to us, and then make our future purchasing decisions accordingly.
With Android's open nature and the level of diversity that allows, Android OS upgrades are never going to be completely consistent across all devices. That's par for the course. I often say that Android presents you with a lot of choices, and if quick and regular upgrades are important to you, you most certainly can have them. You just have to choose a phone that provides that type of experience.
At this point, that basically means Google's own Pixel phones. In addition to being the only flagship devices that receive regular and reasonably fast OS rollouts, they're the only devices that come with a guaranteed three full years of said support. (Two years is the typical standard for an Android flagship, and even that often doesn't get met.) On the midrange to lower-end, of course, you also have the choice of phones that belong to Google's Android One program — a program that, just as we suspected, is being positioned as a lower-cost Nexus-like supplement to the Pixel lineup, with software controlled by Google and timely and regular (though certainly not Pixel-caliber) updates as a result.
As for everyone else, what can you say? Regardless of who's to blame, there's no excuse for keeping customers in the dark for months while costly flagship phones sit idle. This year, once again, the manufacturers had more time than ever to prepare — and yet they somehow still took longer than ever to deliver. At the end of the day, it's up to each manufacturer to decide what level of resources it wants to devote to the upgrade process and how it wants to treat customers along the way. That reality has never been more apparent than now.
(And yes, Google's deconstruction of Android and introduction of standalone security patches have helped make traditional updates much less critical than they once were — a significant progression for the platform, no doubt — but our devices still have meaningful foundational improvements that only full OS upgrades can provide. Timely ongoing upgrades aren't everything, by any means, but they are without a doubt a very significant and valid part of the overall device-owning experience.)
The one bit of reassuring news is that, as always, the power is ultimately in your hands. We may not be able to make manufacturers do better, but we can make ourselves educated about their strategies and behaviors — and then avoid down-the-road disappointments by making the right buying decisions for our own personal needs.
Sign up for JR's new weekly newsletter to get this column along with bonus tips, personal recommendations, and other exclusive extras delivered to your inbox.
In detail: How these grades were calculated
This report card follows the same grading system used with last year's upgrade analysis — which features precise and clearly defined standards designed to weigh performance for both current and previous-generation flagship phones along with a company's communication efforts, all in a consistent manner.
Each manufacturer's overall grade is based on the following formula, with final scores being rounded up or down to the nearest full integer:
- 60% of grade: Length of time for upgrade to reach current flagship phone(s)
- 30% of grade: Length of time for upgrade to reach previous-gen flagship phone(s)
- 10% of grade: Overall communication with customers throughout the upgrade process
Upgrade timing often varies wildly from one country or carrier to the next, so in order to create a consistent standard for scoring, I've focused this analysis on when Android 8.0 first reached a flagship model that's readily available in the U.S. — either a carrier-connected model or an unlocked version of the phone, if such a product is sold by the manufacturer and readily available to U.S. consumers — in a public, official, and not opt-in-beta-oriented over-the-air rollout.
(To be clear, I'm not counting being able to import an international version of a phone from eBay or from some random seller on Amazon as being "readily available to U.S. consumers." For the purposes of creating a reasonable and consistent standard for this analysis, a phone has to be sold in the U.S. in some official capacity in order to be considered a "U.S. model" of a device. I also don't include Android One devices as part of this analysis, as they (a) don't tend to be flagship-caliber devices, and (b) are part of a separate program in which Google handles the software — much like Nexus devices of the past — and thus aren't indicative of a company's upgrade behavior with its own self-controlled flagships.)
By looking at the time to Oreo's first appearance (via an over-the-air rollout) on a device in the U.S., we're measuring how quickly a typical U.S. consumer could realistically get the software in a normal situation. And we're eliminating the PR-focused silliness of a manufacturer rushing to roll out a small-scale upgrade in somewhere like Lithuania just so they can put out a press release touting that they were "FIRST!" The same analysis could be done using any country as its basis, of course, and the results would vary accordingly.
All measurements start from the day Android 8.0 was released into the Android Open Source Project: August 21, 2017, which is when the final raw OS code became available to manufacturers. The following scale determined each manufacturer's subscores for upgrade timeliness:
- 1-14 days to first U.S. rollout = A+ (100)
- 15-30 days to first U.S. rollout = A (96)
- 31-45 days to first U.S. rollout = A- (92)
- 46-60 days to first U.S. rollout = B+ (89)
- 61-75 days to first U.S. rollout = B (86)
- 76-90 days to first U.S. rollout = B- (82)
- 91-105 days to first U.S. rollout = C+ (79)
- 106-120 days to first U.S. rollout = C (76)
- 121-135 days to first U.S. rollout = C- (72)
- 136-150 days to first U.S. rollout = D+ (69)
- 151-165 days to first U.S. rollout = D (66)
- 166-180 days to first U.S. rollout = D- (62)
- More than 180 days to first U.S. rollout (and thus no upgrade activity within the six-month window) = F (0)
There's just one asterisk: If a manufacturer outright abandons any U.S.-relevant models of a device, its score will default to zero for that specific category. Within that specific category (be it current or previous-gen flagship), such behavior is an indication that the manufacturer in question could not be trusted to honor its commitment and provide an upgrade. This adjustment will allow the score to better reflect that reality. (No such adjustments were made this year, though there was one instance where it happened in the past.)
Last but not least, this analysis focuses on manufacturers selling flagship phones that are relevant and in some way significant to the U.S. market. That's why Sony is no longer part of the primary analysis — and why BlackBerry, which I included for a couple of years as it tried to recapture some of the American enterprise market, is also now out.
Most of the other players are either still relatively insignificant in the U.S. market or have focused their efforts more on the budget realm in the States so far — and thus don't make sense, at least as of now, to include in this specific-sample-oriented and flagship-focused report.
[NEW: Android Intelligence videos at Computerworld!]