- A developer made an augmented reality tool that lets people copy and paste objects from the real world.
- In a demo, creator Cyril Diagne uses a smartphone to take a photo of an object and paste it into a digital file.
- The software automatically detects and crops along the edges of an object, turning it into a sticker in a matter of seconds.
- Visit Business Insider’s homepage for more stories.
The line between the physical world and the digital one is blurring – and a new tool lets you drag objects across that line more easily than ever before.
Developer Cyril Diagne built a point-and-click augmented reality tool that lets people use a smartphone to “copy” an image of an object from real life and paste it into a Photoshop file in a matter of seconds.
4/10 – Cut & paste your surroundings to Photoshop
Code: https://t.co/cVddH3u3ik
Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓#ML #AR #AI #AIUX #Adobe #Photoshop pic.twitter.com/LkTBe0t0rF— Cyril Diagne (@cyrildiagne) May 3, 2020
The tool, first reported by The Verge, demonstrates one of the most convenient potential use cases for augmented reality, a technology that has attracted boatloads of venture capital but has struggled to capture consumers’ attention more broadly.
Diagne's software automatically detects and crops along the edges of an object being photographed, turning it into a sticker that can be easily added to a digital file. It also detects when a phone's camera is pointed at a computer screen to automatically "paste" the image. The whole process takes about six seconds, according to Diagne.
And again, the OpenCV SIFT trick to find where the phone is pointing at the screen.
I also packaged it as a small python library: https://t.co/en0EyGSklp
Send a camera image + a screenshot and you get accurate x, y screen coordinates! pic.twitter.com/OOCFrrZseZ
— Cyril Diagne (@cyrildiagne) May 3, 2020
Other developers replied to Diagne sharing similar tools that they're building. While Diagne's tool is still a prototype and not a finished app, the full source code is available on GitHub.