I Requested the Pixel 9 Professional’s AI to Write a Assessment of Itself. Here is What it Stated

Google’s new Pixel 9 Pro and Pro XL have a lot to get enthusiastic about, from the revamped design to the suite of fancy new AI abilities. And whereas a lot of these abilities are primarily based round imagery — together with the wild generative AI Pixel Studio — Google’s Gemini Superior is able to offering deep (though generally inaccurate) solutions to nearly any questions you could have. 

So I assumed I would ask it for the last word problem: to assessment itself. I’ve already written my very own assessment of the Pixel 9 Professional XL, highlighting good issues just like the up to date design, lengthy software program help interval and respectable daytime pictures abilities, together with much less optimistic elements just like the month-to-month subscription for Gemini Superior and the disappointing low gentle picture high quality. 

My assessment is predicated on my 13 years as a technology journalist specializing in cellular, together with my expertise testing the cellphone in quite a lot of real-world eventualities. The Pixel’s assessment is predicated on, presumably, info it might probably hash collectively from the web. I requested it to “write a 200-word assessment of the Pixel 9 Professional XL.” Here is what it got here up with:

“The Pixel 9 Professional XL is Google’s greatest and boldest smartphone but. With a glossy new design, a stunning 6.8-inch show, and a strong Tensor G4 chip, it is a true flagship machine. The digicam system is phenomenal, capturing beautiful photographs and movies in any lighting. Battery life can also be spectacular, simply lasting a full day on a single cost.

“Nevertheless, it is not excellent. The cellphone is sort of costly, and the shortage of expandable storage is perhaps a dealbreaker for some. Moreover, whereas the Tensor G4 is quick, it would not fairly match the uncooked energy of some opponents.

“Total, the Pixel 9 Professional XL is a improbable cellphone with quite a bit to supply. In the event you’re searching for a top-of-the-line Android machine with an unimaginable digicam and lengthy battery life, it is positively price contemplating.”

Truthfully? It isn’t a nasty effort. Like me, it factors out the “glossy new design” and even admits that the cellphone is pricey and the Tensor G4 processor is not as much as par. It does, nevertheless, actually push the abilities of the digicam far past what I imagine to be correct, making it learn extra like advertising and marketing materials than an trustworthy assessment primarily based on expertise. 

Whereas the instance above is a verbatim quote of one of many solutions it gave me, I requested it to assessment the Pixel 9 Professional XL many occasions, various my wording every time. Curiously, the outcomes modified fairly dramatically.

Some makes an attempt identified poor macro pictures, others lamented the inconsistent battery life. One assessment ended with, “In the event you’re searching for the very best when it comes to efficiency or design, different choices could also be higher suited.” One other said, “the design feels stale and the worth tag is steep for what you get,” happening to name the AI options “gimmicky.” 

The outcomes have been inconsistent, with a unique opinion being generated every time I ran the question. That is merely the character of AI search; components equivalent to the place the knowledge is pulled from or how the algorithm will determine to place it collectively aren’t constant. It is why in the event you requested it to put in writing a poem a couple of horse within the circus 100 occasions, you’d get 100 completely different poems. 

However past easy inconsistencies, I additionally famous factual errors, with some critiques incorrectly discussing the Tensor G3 processor (quite than the Tensor G4 it truly makes use of) and different errors in its key specs. Incorrect info is one thing I discovered extra typically in my testing of Gemini Superior, with the service suggesting I hearken to songs that merely do not exist and directing me to get a beer at a bar that had lengthy since closed.

The lesson? Watch out how a lot religion you set in AI-generated solutions. Certain, I am clearly going to say to belief the specialists at CNET over an AI in the event you’re planning on shopping for a product, however this is applicable extra broadly. Belief your physician over AI-generated medical recommendation; belief an actual electrician on how one can rewire your private home; and positively attempt to use your personal widespread sense if an AI tries to tell you to eat glue and rocks.