Removing reflections from photos takes time and effort. Adobe’s talented engineers are working to solve the issue once and for all in a single click.
Polarizing filters are an effective way to reduce or entirely remove reflections from objects like glass windows. However, not every photographer wants to carry a filter around with them all the time, so what can be done after the image is already captured? Historically, not much. Removing window reflections manually in image editing tools is tedious and woefully ineffective. However, armed with artificial intelligence, Adobe Camera Raw’s latest update solves this issue, rescuing countless shots.
AI remains a contentious topic among photographers for very good reasons. However, AI has the potential to save photographers significant time without wresting away creative control. Some recent features in Adobe Photoshop and Lightroom have maintained a nice balance here, including AI-powered masking, lens blur, and Generative Expand. Not every tool has hit the mark, but the new Reflection Removal one offers significant promise.
“Reflections are sometimes useful. For example, they help you distinguish between different materials. However, reflections that show recognizable objects are typically unwanted and get in the way of photography,” Adobe explains in a new blog post. “Indeed, we often give up taking a unique photo that we expect will be ruined by a reflection. So while few of the photos in our collections might contain unwanted reflections, this is mainly because we passed up many creative opportunities.”
Common examples of times reflections have a ruinous impact on photography include photographing landscapes through airplane windows, capturing travel photos at museums (that allow photography, of course), and maybe even capturing photos of animals at a zoo or wildlife rehab center. Windows and glass objects are everywhere, so there are countless times a photographer must contend with reflections.
However, sometimes reflections are themselves part of an image’s appeal. Few want to remove reflections of the sky from a lake, for example. Removing tiny reflections is rarely tricky to do manually. So, Reflection Removal is explicitly designed to deal with unintended, unwanted reflections that dramatically impact the look of the image. At least for now, more minor reflections are in the team’s sights for future iterations.
It’s a complicated problem to solve, though. As Adobe explains, a photograph “polluted by a reflection” is really the combination of two images. There is the scene the shooter wanted to capture, and then there is the second image, a reflected view of the scene behind the camera. The trick to removing a reflection from a photo is to disentangle these two different photos in a single frame. Adding noise to the issue is that reflections are not perfect. Glass is often dirty or smudged, interacts differently with light than the scene behind the glass, and usually has different degrees of focus and varying white balance.
“Also, in photos that contain reflections, if two edges cross, like the edges of the turntable and the legs of the photographer, it’s probably due to a superimposed reflection, because the edges of opaque objects don’t cross in nature,” Adobe adds.
Adobe trained its new Reflection Removal system using thousands of photos of different subjects without reflections. The team then combined pairs of these training images to simulate photographs with reflections. Since the team knew the ground truth of each picture, it could correct the model along the way, helping it improve over time.
“By repeating this training process over many examples, the model learns how to separate the two images in a photograph that is polluted by reflections,” writes Adobe.
As for the tool’s efficacy, it remains a work in progress. However, Adobe’s examples are impressive. Once the model finishes its work, the user can control how much a reflection is removed from the scene, from zero (no removal) to 100 (complete removal).
“Sometimes our model mixes up the scene behind the window and the reflected scene — that’s why we give you a two-ended slider,” Adobe says. “But because our model is not generative AI, it will never create objects that weren’t present in the original photograph.”
Although this new tool is impressive, Adobe says the “best way to remove reflections from a photograph is to avoid them in the first place.” But for times when that’s impossible, Reflection Removal shows promise.
For now, Reflection Removal only works with RAW photos, although JPEG, HEIC, and other non-RAW image support are planned. It is now available as a Technology Preview with Adobe Camera Raw, and the team anticipates bringing an expanded version to the entire Lightroom ecosystem in the future.
Reflection Removal is developed by Eric Kee and Adam Pikielny, with help from Jiawen Chen, Lars Jebe, Durga Ganesh Grandhi, Eric Chan, Thomas Knoll, Simon Chen, Frieder Gans, and Kevin Matzen.
“We believe our technology is the best-performing feature of its kind,” Adobe says. “So we’re excited to see what you do with it!”
Image credits: Adobe
Adobe’s New Reflection Removal Tool Aims to Save Your Travel Photos
Recent Comments
Boise State vs. Air Force live stream, odds, channel, prediction, how to watch on CBS Sports Network
on
CONCEPT ART: New Details Revealed for Disney Cruise Line Lookout Cay at Lighthouse Point Destination
on
College basketball rankings: Kansas helps Big 12 lead conference race for most Top 100 And 1 players
on
Inside Floyd Mayweather’s Lavish Lifestyle: A Look at His Stunning Car Collection and Private Jet
on
Cruise guest gets stuck on ‘claustrophobic’ water slide suspended over ocean: ‘That is super scary’
on
David and Victoria Beckham so ‘Charmed’ by Tom Cruise They Have His Photos on Display at Their Home
on
Boston College vs. Army live stream, how to watch online, CBS Sports Network channel finder, odds
on
Big Tech companies will cover travel expenses for employees’ medical procedures, including abortion
on
Russian cruise and ballistic missiles kill 4 in Ukraine and Ukrainian rockets kill 2 in Russian city
on
A weaker dollar, skyrocketing prices and ‘record’ visitor numbers: Good luck in Europe this summer
on
GameFly Sale Offering Nintendo Switch Sports at a Mind-Blowing Price, Don’t Miss the Opportunity!
on
Ford Blue Cruise: US regulators investigate fatal crashes involving hands-free driving technology
on
San Mateo County Community College District sues five companies over role in ‘pay to play’ scandal
on
2024 Super Bowl: CBS Sports Network and CBS Sports HQ to combine for 115 hours of weeklong coverage
on
Despite strong Lunar New Year holiday data, consumer spending in China isn’t roaring back just yet
on
2023 NFL All-Rookie Team: CBS Sports draft expert, former GM unveil league’s best first-year players
on
Devout athletes find strength in their faith. But practicing it and elite sports can pose hurdles
on
The Rev. Al Sharpton to lead protest after Florida governor’s ban of African American studies course
on
After UFC Fallout, Conor McGregor Offers a Valuable Piece of Advice to Free Agent Francis Ngannou
on
CONCEPT ART: New Details Revealed for Disney Cruise Line Lookout Cay at Lighthouse Point Destination
on
Saipan, placid island setting for Assange’s last battle, is briefly mobbed – and bemused by the fuss
on
CONCEPT ART: New Details Revealed for Disney Cruise Line Lookout Cay at Lighthouse Point Destination
on
David and Victoria Beckham so ‘Charmed’ by Tom Cruise They Have His Photos on Display at Their Home
on
Iowa State starting RB Jirehl Brock among latest college football players charged in gambling probe
on
Biden to tout bill’s prescription drug prices, energy provisions in pitch to Americans, aide says
on
Iowa State starting RB Jirehl Brock among latest college football players charged in gambling probe
on
The Rev. Al Sharpton to lead protest after Florida governor’s ban of African American studies course
on
Sports World Hails ‘Superwoman’ Lindsey Vonn for Her Grand Comeback Despite Career-Changing Injury
on
San Mateo County Community College District sues five companies over role in ‘pay to play’ scandal
on
Saipan, placid island setting for Assange’s last battle, is briefly mobbed – and bemused by the fuss
on
‘Pokémon Scarlet’ and ‘Violet’ Fan Theories Suggest Legendary Time Travel, Alternate Dimension Plot
on
Joe Manchin and Tommy Tuberville introduce bill on name, image and likeness rules for college sports
on
Inside the Michael Jordan ‘Air’ movie, plus why NFL, others are buying into the sports film industry
on
If you’re a frequent traveler, these wrap tops from Aday will revolutionize your on-the-go wardrobe
on
How Does Jack Nicklaus Travel? Exploring the Private Jets Owned by the ‘Golden Bear’ Over the Years
on
Hollywood Reporter: Tom Cruise negotiated with movie studios over AI before the actors strike began
on
Ford Blue Cruise: US regulators investigate fatal crashes involving hands-free driving technology
on
Dozens of boats cruise the Seine in a rehearsal for the Paris Olympics’ opening ceremony on July 26
on
Devout athletes find strength in their faith. But practicing it and elite sports can pose hurdles
on
Despite strong Lunar New Year holiday data, consumer spending in China isn’t roaring back just yet
on
David and Victoria Beckham so ‘Charmed’ by Tom Cruise They Have His Photos on Display at Their Home
on
CONCEPT ART: New Details Revealed for Disney Cruise Line Lookout Cay at Lighthouse Point Destination
on
CBS Sports announces Matt Ryan will join NFL studio show. Longtime analysts Simms and Esiason depart
on
Boston College vs. Army live stream, how to watch online, CBS Sports Network channel finder, odds
on
Boise State vs. Air Force live stream, odds, channel, prediction, how to watch on CBS Sports Network
on
Biden to tout bill’s prescription drug prices, energy provisions in pitch to Americans, aide says
on
After UFC Fallout, Conor McGregor Offers a Valuable Piece of Advice to Free Agent Francis Ngannou
on
2024 Super Bowl: CBS Sports Network and CBS Sports HQ to combine for 115 hours of weeklong coverage
on
‘Best Intention’: Chris Kirk Has Absolute Trust in Jay Monahan and PGA Tour’s Widely Debated Model
on
2023 NFL All-Rookie Team: CBS Sports draft expert, former GM unveil league’s best first-year players
on
“Completely Knocked Me Out”: Rob Lowe Recalls Boxing Match With Tom Cruise On 1983 Brat Pack Classic
on
CONCEPT ART: New Details Revealed for Disney Cruise Line Lookout Cay at Lighthouse Point Destination
on
“Completely Knocked Me Out”: Rob Lowe Recalls Boxing Match With Tom Cruise On 1983 Brat Pack Classic
on
CBS Sports announces Matt Ryan will join NFL studio show. Longtime analysts Simms and Esiason depart
on
Carlos Sainz’s Soccer Fanboy Emerges as Spaniard Shares Defining Moment With This Real Madrid Legend
on
Biden: ‘At this point I’m not’ planning to visit East Palestine, Ohio, after toxic train derailment
on
‘Best Intention’: Chris Kirk Has Absolute Trust in Jay Monahan and PGA Tour’s Widely Debated Model
on
Ahead of big sports weekend, dispute with Disney leaves millions of cable subscribers in the dark
on
A heavy wave of Russian missile attacks pounds areas across Ukraine, killing at least 4 civilians
on
2024 Super Bowl: CBS Sports Network and CBS Sports HQ to combine for 115 hours of weeklong coverage
on
2023 NFL All-Rookie Team: CBS Sports draft expert, former GM unveil league’s best first-year players
on
Army vs. Coastal Carolina live stream, how to watch online, CBS Sports Network channel finder, odds
on
AL Rookie of the Year Julio Rodriguez Spreads Joy and Sportsmanship to the Youth of Loma de Cabrera
on
After UFC Fallout, Conor McGregor Offers a Valuable Piece of Advice to Free Agent Francis Ngannou
on
Dubai International Airport sees 41.6 million passengers in first half of year, more than in 2019
on
Devout athletes find strength in their faith. But practicing it and elite sports can pose hurdles
on
Despite strong Lunar New Year holiday data, consumer spending in China isn’t roaring back just yet
on
Dave Portnoy: Taylor Swift’s security should ‘drag Kim Kardashian to jail’ if she attends Eras Tour
on
CONCEPT ART: New Details Revealed for Disney Cruise Line Lookout Cay at Lighthouse Point Destination
on
“Completely Knocked Me Out”: Rob Lowe Recalls Boxing Match With Tom Cruise On 1983 Brat Pack Classic
on
CBS Sports, Serie A announce new TV rights deal; Paramount+ to air over 400 Italian soccer matches
on
Cam Newton’s Violent Public Incident Draws Hilarious Reaction From 3x All-Star: “Where Do I Sign Up
on
Boston College vs. Army live stream, how to watch online, CBS Sports Network channel finder, odds
on
Angel Reese Launches Foundation Dedicated To Empowering Women Through Sports & Financial Literacy
on
A weaker dollar, skyrocketing prices and ‘record’ visitor numbers: Good luck in Europe this summer
on