Revolutionizing Photography: Google Pixel 9 Unveils AI-Powered Camera Magic

To go back to this article, head to My Profile, and then look at your saved stories.

Google Pixel 9 Introduces Enhanced AI-Driven Photography Magic

For years, Google's Pixel phones have been celebrated for their superior camera functionality. Lately, however, the tech giant has been infusing its photographic technology with artificial intelligence enhancements that push the boundaries of what's possible. Capturing an image has evolved beyond simply pressing a button to snap a good photo. Presently, it's possible to eliminate unwanted elements, reposition figures within an image, and allow AI to reconstruct the scenery, alongside the ability to strip bothersome noises such as alarm sounds from video recordings. The latest Pixel 9 lineup takes things up a notch by incorporating advanced generative AI features that can modify, refine, and effectively elevate your photography experience.

Google has announced a complete overhaul of the HDR+ pipeline in its Pixel 9 series, a sophisticated image processing algorithm that optimizes contrast, exposure, colors, and shadows in photos. Additionally, innovative features such as Add Me, Reimagine, Autoframe, and Zoom Enhance extend beyond just capturing images, simplifying processes that once needed some technical expertise in photo editing software. Below is an overview of these updates.

For an in-depth exploration of the development process behind these features, check out my unique interview with the Google Pixel camera team members.

Purchases made through links in our articles could result in a commission for us. This contribution aids in funding our journalistic endeavors. For further details, click here.

Join In

Ever found yourself wanting to capture a moment with a loved one or family members with a famous landmark, such as the Eiffel Tower, in the background, but faced the dilemma of who should take the photo? Rather than entrusting your $1,000 smartphone to a passerby, Join In offers a solution for this issue.

The Pixel 9 smartphones feature an innovative mode designed for taking unique photos. Initially, it prompts the user to pan their phone around the area. Afterward, you capture an image with a friend or family member positioned in front of any backdrop, then you switch roles. As the second photographer steps in, they're greeted with a semi-transparent overlay of their own image on the screen, along with a suggestion from the app on where to position themselves. Hitting the capture button, the software cleverly merges the two images, creating the illusion that both individuals were together in the shot, despite being photographed separately.

In my initial trials, it performed effectively, and of course, I experimented to find out if it was possible to clone myself. This was successful on one occasion, yet all subsequent efforts were unsuccessful. The reason being, according to Google, it's not engineered for an individual to appear more than once. Perhaps altering your attire or significantly changing your appearance may help. Further experiments are necessary to determine its efficiency, especially for scenarios where you aim to simulate placing your arm around someone else's shoulder.

Introducing a New Feature in Magic Editor

Google's Magic Editor has recently been enhanced with a new feature named Reimagine. Presently, the tool offers functionalities such as repositioning subjects within an image or removing unwanted elements. With the introduction of Reimagine, users now have the ability to highlight a specific section of an image, after which they are prompted to describe their desired modifications through text. The range of potential alterations is broad, encompassing changes from day to night, the insertion of turbulent clouds, or even, as in my own experiment, placing a UFO above the Empire State Building.

According to Google, providing detailed descriptions enhances the outcomes. Yet, the company mentions its technology is more effective with sceneries and items rather than individuals, implementing safeguards to prevent modifications to a person's appearance. This concept is akin to Samsung's Image from Sketch capability found in their newest foldable smartphones, with the notable difference being Samsung's method requires a drawing of the desired result instead of textual input.

Reimagine might not always hit the mark—there are instances when it fails to deliver any relevant outcomes based on the input, or the outputs it provides are subpar. However, it does offer four different options to select from, and there's always the possibility of giving it another go with a more detailed description.

Framing Techniques

Achieving the right composition is crucial in photography. For those who find that utilizing the grid lines feature in their smartphone camera apps (a common option found in the camera settings) does not aid in aligning their shots properly, Google believes that generative AI could be the solution to improving this aspect.

Autoframe resides within Magic Editor, similar to Reimagine. When you're in the process of editing an image, you can choose the Autoframe feature. By selecting it, the system creates four variations of your image with altered framing. For instance, I deliberately captured an image with myself positioned near the frame's edge, which wasn’t ideal from a composition standpoint. Upon utilizing Autoframe, it added pixels around the top and right side of my position, nudging me towards the center in alignment with the well-established rule of thirds. It even provided a vertical rendition of what was originally a horizontal snapshot.

These "created pixels" essentially grasp the context of the image and enhance the perimeter of the picture, ensuring it appears seamless, despite being entirely synthetic. During my experimentation with various images, the technology couldn't discern the actual extent of the tree to my left or the length of the fence, leading to some educated guesses. Upon close inspection, you might spot a few inaccuracies, yet the majority of observers are unlikely to detect any discrepancies.

Zoom Enhance Makes Its Debut

Initially revealed alongside the Pixel 8 by Google, Zoom Enhance was delayed from its original launch due to not being fully developed. It's now making its debut with the Pixel 9 lineup and is expected to be available on Pixel 8 devices in the future. At present, Google employs its Super Res Zoom technology to sharpen images when zooming in before taking a photo. Zoom Enhance, on the other hand, is designed to enhance image quality after the photo has been taken.

Within the Google Photos application, choose the picture you wish to enlarge, press the Edit option, then navigate to Tools to locate the Zoom Enhance feature. You must zoom into the desired section, then select Zoom Enhance. Mirroring techniques from CSI series in the early 2000s, it will refine the image by creating pixels, resulting in a clearer appearance. When I experimented with this feature on distant buildings, the outcome was significantly improved clarity, with the lines becoming sharper and the formerly blurry image now appearing more defined.

Additional Camera Enhancements

The Pixel 9 series, along with the Pixel 9 Pro Fold, features several significant camera advancements.

In the previous year, the Pixel 8 Pro by Google launched a feature known as Video Boost. This function, once activated, uploads your video to Google's cloud servers for enhancement, which enhances the overall video quality and brightness, diminishes noise, and betters the stabilization process. After a short while, you would receive an alert informing you that your video has been processed and is ready for sharing. Additionally, you retain the option to share the original, unenhanced version of the video right away.

The Pixel 9 Pro lineup has received enhancements, doubling its processing speed compared to the previous year. The new feature, Video Boost, activates by itself when you switch to the Night Sight option within the Video setting, eliminating the need for manual activation. This feature is compatible with the telephoto lens, supporting up to 20X zoom through Super Res Zoom, and it has the capability to enhance your videos to 8K quality. Google claims this will result in the “finest smartphone video experience,” a statement that warrants further examination.

Panorama, often an underutilized feature, typically comes into play when you reach a breathtaking vista at the end of a hike. Google has announced a comprehensive overhaul of this feature, integrating the latest HDR+ and Night Sight technologies for enhanced quality. Additionally, a fresh method for taking these panoramic shots has been introduced. Upon initiating a Panorama, users now select a direction (either left or right) and will encounter specific points across the horizon where they must stop momentarily to allow their phone to snap the picture. This updated capture mechanism is quite reminiscent of Google's Photosphere feature.

Image captured by: Julian Chokkattu

Recommended for You …

Directly to your email: A selection of our top stories, curated daily just for you

A faulty CrowdStrike patch led to global computer outages

The Headline Feature: When is the Atlantic Ocean expected to divide?

Introducing the age of excessive online consumption

WIRED PROMOTIONS

Offer on Dyson Airwrap: Complimentary $60 Case Plus $40 Bonus Gift

Enjoy Up to an Additional 45% Discount on Our August Clearance Event

Vista Print Promo Code: Save 20% on Certain Signs

Newegg Discount Code: Save 10%

Access Peacock Premium for as Low as $7.99 Each Month

Discover the Academic Savings and Special Deals for Students from DJI in 2024

Additional Content from WIRED

Critiques and Tutorials

© 2024 Condé Nast. All rights reserved. Purchases made through our site may result in WIRED receiving a commission, as part of our association with retailer affiliate programs. Any use of content from this site, including reproduction, distribution, transmission, or caching, is prohibited without prior written consent from Condé Nast. Ad Choices.

Choose a global location