By this point, it's no secret that Android upgrades are a mess — but this was supposed to be the cycle where everything got better.
Google's Android 9 Pie release was the first Android version to feature the full benefits of Project Treble, a complex effort to make it easier for manufacturers to update their devices with new operating system versions. And lemme tell ya: Such a solution has never been more desperately needed.
Last year's Oreo upgrade marked the worst performance by device-makers we've ever seen on Android — and when you consider the already-rock-bottom starting point, combined with the sharp downward slope in upgrade delivery times over the past several years, well, that's really saying something.
With Pie, the story is a mix of good and bad news: On the positive side, there's definitely been some progress this year — and parts of the picture are a bit less bleak than they were with Oreo. At the same time, the overall picture is pretty darn depressing, especially when it comes to Android's most powerful and relevant hardware-making companies. Improvement is all relative, and these results really speak for themselves. (And if you think Android upgrades don't really matter, do me a favor and go read this.)
Now that we're six full months past the launch of Android 9 Pie, it's time to step back and look at who's making upgrades a priority and who's treating them as an afterthought. Get ready for some raw, honest, data-driven truths — and for a more detailed look at what these results tell us about Treble, see my separate analysis: "Android Pie and Project Treble: Did Google's upgrade fix work?"
(Want the full nitty-gritty on how these grades were calculated? You can find a detailed breakdown of the formula and every element taken into account at the very end of this article.)
- Length of time for upgrade to reach current flagship: 0 days (60/60 points)
- Length of time for upgrade to reach previous-gen flagship: 0 days (30/30 points)
- Communication: Excellent (10/10 points)
It's no surprise to see Google leading the pack with a solid "A" score in this latest Report Card — but it is worth noting that Google has actually earned its highest grade ever with its first 100% mark this go-round. In past analyses, Google has either faltered — slightly — with its previous-gen flagship, or at the very least lost some points for leaving certain models of its phones hanging longer than others and then failing to communicate anything about its progress to the people who own said products.
This year, the big G started rolling out Pie to both its then-current-gen Pixel 2 phone and its then-previous-gen original Pixel model on the same day the software was announced. (For the purposes of this analysis, it's the start of a rollout — to a flagship phone model in the U.S. — that counts.) And while the usual "rolling out in waves" asterisk applied, Pie made its way to all Pixel owners within a reasonable amount of time, without the need for any extra communication beyond the company's initial announcement.
Pixel upgrades may not always be immediate, given the staged rollout process Google likes to use, but they are always quite speedy — and consistently in a league of their own. Sure, we could argue that Google has a unique advantage in that it's both the manufacturer of the devices and the maker of the software, but guess what? That's part of the package.
And the results tell you all there is to know: Google's phones are without question the most reliable way to receive ongoing updates in a timely manner on Android. It's the only company that overtly makes a guarantee about that, let alone delivers on it — and it's the only company that now offers such support for a full three years from a phone's launch date, compared to the typical two-year window, thereby giving its devices even greater long-term value.
OnePlus
- Length of time for upgrade to reach current flagship: 47 days (53/60 points)
- Length of time for upgrade to reach previous-gen flagship: 142 days (21/30 points)
- Communication: Poor (0/10 points)
Coming into second place for its second straight year, OnePlus did reasonably well with getting Pie onto all of its recent devices. The then-current-flagship, the OnePlus 6, saw its upgrade in late September — a respectable if not exemplary month and a half after the software's release. (The OnePlus 6T didn't come out until November, after Pie's release, so it isn't relevant to this analysis.) The dual second-gen flagships, meanwhile — the OnePlus 5 and 5T — both received their upgrades just under five months after Pie's arrival, right before the end of 2018.
As has been the case in the past, OnePlus didn't do much in the way of communication with customers — no official estimates, no promises, no meaningful updates or ETAs along the way. The only real communication was an announcement in the company's forums that a rollout was beginning. So if you owned a OnePlus device, all you could do was wait blindly and hope the upgrade might show up on your phone soon.
All in all, it's a decent performance, and it's heartening to see OnePlus steadily improving with each passing year. (Last year, while it still rather astonishingly held the second place position, the company came in with a pretty poor 65% "D" score.) So there's plenty of good stuff to be said for its efforts.
Even so, a 74% "C" grade shouldn't be the second best upgrade delivery performance by any Android manufacturer. And, just like last year, things get way, way worse from here.
Samsung
- Length of time for upgrade to reach current flagship: 177 days (37/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (0/10 points)
Credit where credit's due: Samsung actually got Pie onto some U.S. flagships within the first six months of the software's release. That's more than we can say for the company's efforts last year, with Oreo, when it had accomplished absolutely nothing by this point and consequently received a big fat zero in this assessment.
But, c'mon: Taking just shy of six months to get a major operating system update onto your current-gen flagship is not cause for celebration. When you set the bar embarrassingly low the previous year, with a nearly seven-month wait time for your highest-priority customers, sure: There's (hopefully) only room for improvement from there. But this is hardly a respectable result, and we still haven't heard a peep about when Pie will make its way to owners of Samsung's previous-gen flagship products.
In the bigger picture, all Samsung has really done here is return to its minimal-effort level from two years earlier, with the Android 7.0 Nougat rollout. That rollout was a big step backwards from Samsung's performance with Marshmallow, which itself was a big step backwards from its results with Lollipop. (And, you guessed it: That result was nothing to write home about, either.) Adding insult to injury, Samsung never makes any effort to communicate with customers about the process or what can be expected.
Samsung can — and should — do better. As I've said more times than I can count, particularly for a company of its size and with its immense financial and engineering-related resources, not being able to deliver updates to people after all those months (with the benefits of Treble in place, no less) comes down to one thing and one thing only: priorities.
Motorola (Lenovo)
- Length of time for upgrade to reach current flagship: Still waiting (0/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (3/10 points)
Man, I miss the days when Motorola was a shining high point on these reports. This year, the now-Lenovo-owned company has yet to deliver a taste of Pie to any flagship-owning customer — including those who bought its current-gen flagship, the Moto Z3, and those who paid good money for its previous-gen top-of-the-line phone, the Moto Z2 Force. (Some reports last month suggested the rollout for the Z3 was beginning, but those were based solely on the presence of a support page on Motorola's website that has since been taken offline. I've seen zero indication that any rollout ever actually began.)
There is one interesting asterisk to this: Motorola did deliver Pie to its midrange Moto X4 phone in the middle of December. My guess is that that's because the X4 is also available as an Android One phone, which means it has a model that ships with "stock" Google software and is part of a contractual agreement with Google that requires Motorola to deliver OS updates within a certain window. This pretty clearly suggests that when Moto has the motivation and has to make an upgrade happen in a semi-reasonable amount of time, it can do it. But when it doesn't have the motivation? The data says it all.
Regardless, for the sake of consistency and establishing a metric for comparison, this analysis focuses solely on regular flagship phones that are readily available in the U.S. (you can read more about my methodology here) — and that means, unfortunately for Moto, its midrange phone upgrade doesn't factor into this result.
The company does get a few points for putting in a minimal amount of effort on the communication front and at least releasing a list of which devices would be updated shortly after Pie's release. Motorola also still maintains a database where you can search for info about the upgrade status of any particular device model. But the initial announcement contained no specific timing info — not even vague estimations — and the database, a leftover from the company's Google-owned era, is barely even updated anymore and doesn't seem to contain any specific info about the progress or likely launch window for any phone's upgrade.
It's a token effort, basically — a relatively empty one — and so a few points are all it can earn.
HTC
- Length of time for upgrade to reach current flagship: Still waiting (0/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (2/10 points)
If there's any company that can come close to matching Moto's fall from grace, it's HTC. The once-admirable device-maker has been in a freefall for the past few years with upgrade performance — probably no surprise, given its ongoing financial struggles — and the Android 9 Pie upgrade marks a new low for the company responsible for Android's very first handset.
There's not a heck of a lot to say, really: HTC hasn't accomplished a single thing in these first six months since Pie's release. No rollouts, no updates, no announcements regarding its own regular phones beyond one initial vague Twitter posting about which devices would eventually be upgraded (for which the company received a couple of "minimal effort" communication points — it may not be much, but it's still more than some other players do on that front). The company's once-exemplary "Software Updates" page, meanwhile — where HTC used to post detailed information about the update status for every model and variant in its catalog — has long been abandoned.
Looking at all of this, I can't help but think back to my 2016 column: "Why HTC may be the next Motorola of Android." Sigh.
LG
- Length of time for upgrade to reach current flagship: Still waiting (0/60 points)
- Length of time for upgrade to reach previous-gen flagship: Still waiting (0/30 points)
- Communication: Poor (0/10 points)
When it comes to Android upgrades, LG is nothing if not consistent. The company has managed to accomplish exactly jack-squat in the first six months of Pie's life — no rollouts, no communication, no discernible progress or attempt to so much as even pretend it gives the tiniest hoot about what happens to its own regular phones once they're out of the box and into a human's hands.
What makes this particularly galling is the fact that LG did take the time to try to get positive publicity out of its creation of a "Software Update Center" — the industry's "first such facility aimed at providing customers worldwide with faster, timelier smartphone operating system and software updates" (!) — last April.
Um, yeah. Right.
I'll say what I've said before: If you buy a phone from LG, you're accepting the fact that you'll be waiting in the dark — likely for a very long time — to see if or when you'll ever get any future updates. You'd better make sure you're okay with that black hole before shelling out your hard-earned shekels.
Sony, Essential, and Nokia: A few quick footnotes
This report card focuses on the companies most relevant to the U.S. flagship market, as explained in the methodology section below, but I wanted to quickly call out a few other notable Android players.
Sony, which has become increasingly irrelevant in the U.S. market over time, managed to get Pie onto its current-gen Xperia XZ2 flagship in mid-October — just over two months after the software's release — and then onto its previous-gen Xperia XZ a mere matter of weeks after that. Its communication efforts were better than most, with an early announcement that included not only which devices would receive the upgrade but also roughly when those rollouts would begin and then a couple of subsequent updates to that information. All considered, if we were including it in this analysis, it'd have earned a solid 83% "B" score — enough that it would have claimed the second-place spot and outperformed everyone other than Google.
Essential, meanwhile — which hasn't sold a significant number of phones, didn't even release a phone in 2018, and may or may not ever release another Android phone — is absolutely killing it when it comes to support of its sole 2017-launched device. The company got Pie out to owners of its eponymous Essential Phone on the same day as the software's release. Essential is nowhere near relevant enough to earn a spot in this analysis, to say the least, but if it were ever able to get its act together and become a force in the U.S. mobile market, it'd sure be a force to be reckoned with in this domain.
Last but not least is Nokia — still a relative newcomer to the Android game. The company has an extremely limited presence in the U.S., with just a few budget-level phones available stateside as of now. In the global picture, though, Nokia has consistently done a solid job of keeping its phones updated with both major and minor OS releases and with monthly security patches, some two-ish years into its term as an Android manufacturer.
Interestingly, Nokia is now making all of its phones part of Android One — which means they'll all be guaranteed to receive reasonably timely ongoing upgrades as part of that agreement with Google. That puts Nokia in a very unusual position when it comes to software support within Android and certainly sets it apart from everyone else, even if it doesn't make sense to include it as a formal part of this analysis as of now.
Sign up for my weekly newsletter to get more practical tips, personal recommendations, and plain-English perspective on the news that matters.
In detail: How these grades were calculated
This report card follows the same grading system used with last year's analysis — which features precise and clearly defined standards designed to weigh performance for both current and previous-generation flagship phones along with a company's communication efforts, all in a consistent manner.
Each manufacturer's overall grade is based on the following formula, with final scores being rounded up or down to the nearest full integer:
- 60% of grade: Length of time for upgrade to reach current flagship phone(s)
- 30% of grade: Length of time for upgrade to reach previous-gen flagship phone(s)
- 10% of grade: Overall communication with customers throughout the upgrade process
Upgrade timing often varies wildly from one country or carrier to the next, so in order to create a consistent standard for scoring, I've focused this analysis on when Android 9 first reached a flagship model that's readily available in the U.S. — either a carrier-connected model or an unlocked version of the phone, if such a product is sold by the manufacturer and readily available to U.S. consumers — in a public, official, and not opt-in-beta-oriented over-the-air rollout.
(To be clear, I'm not counting being able to import an international version of a phone from eBay or from some random seller on Amazon as being "readily available to U.S. consumers." For the purposes of creating a reasonable and consistent standard for this analysis, a phone has to be sold in the U.S. in some official capacity in order to be considered a "U.S. model" of a device. I also don't include Android One devices as part of this analysis, as they (a) don't tend to be flagship-caliber devices, and (b) are part of a separate program that has contract-based requirements for upgrade delivery timing and relies on Google's Android software instead of a company's own take on the operating system. Consequently, those devices exist in a category of their own and aren't indicative of a company's upgrade behavior with its own self-controlled flagships.)
By looking at the time to Pie's first appearance (via an over-the-air rollout) on a device in the U.S., we're measuring how quickly a typical U.S. consumer could realistically get the software in a normal situation. And we're eliminating the PR-focused silliness of a manufacturer rushing to roll out a small-scale upgrade in somewhere like Lithuania just so they can put out a press release touting that they were "FIRST!" The same analysis could be done using any country as its basis, of course, and the results would vary accordingly.
All measurements start from the day Android 9 was released into the Android Open Source Project: August 6, 2018, which is when the final raw OS code became available to manufacturers. The following scale determined each manufacturer's subscores for upgrade timeliness:
- 1-14 days to first U.S. rollout = A+ (100)
- 15-30 days to first U.S. rollout = A (96)
- 31-45 days to first U.S. rollout = A- (92)
- 46-60 days to first U.S. rollout = B+ (89)
- 61-75 days to first U.S. rollout = B (86)
- 76-90 days to first U.S. rollout = B- (82)
- 91-105 days to first U.S. rollout = C+ (79)
- 106-120 days to first U.S. rollout = C (76)
- 121-135 days to first U.S. rollout = C- (72)
- 136-150 days to first U.S. rollout = D+ (69)
- 151-165 days to first U.S. rollout = D (66)
- 166-180 days to first U.S. rollout = D- (62)
- More than 180 days to first U.S. rollout (and thus no upgrade activity within the six-month window) = F (0)
There's just one asterisk: If a manufacturer outright abandons any U.S.-relevant models of a device, its score defaults to zero for that specific category. Within that specific category (be it current or previous-gen flagship), such behavior is an indication that the manufacturer in question could not be trusted to honor its commitment and provide an upgrade. This adjustment allows the score to better reflect that reality. (No such adjustments were made this year, though there was one instance where it happened in the past.)
Last but not least, this analysis focuses on manufacturers selling flagship phones that are relevant and in some way significant to the U.S. market. That's why Sony is no longer part of the primary analysis — and why BlackBerry, which I included for a couple of years as it tried to recapture some of the American enterprise market, is also no longer included.
Most of the other players are either still relatively insignificant in the U.S. market or have focused their efforts more on the budget realm in the States so far — and thus don't make sense, at least as of now, to include in this specific-sample-oriented and flagship-focused report.
[Android Intelligence videos at Computerworld]