How poorly upscale AI really works

Answered

Comments

6 comments

  • Avatar
    Hilltops

    Yes, amazing result but I believe that it has been achieved by reconstructing the face on the basis of a database of images rather than by restoring details of the picture itself.. So, this is not the face of the person in the original photo but rather a 'lookalike'. And I've seen some TPai results that were not very good.

    0
    Comment actions Permalink
  • Avatar
    Margaret Bright

    Dear Member,

    Thank you for your detailed feedback! I have forwarded it to our developers along with the link to the photos you have kindly provided. I will have them take a deeper look and see how we can improve the work of the tool.

    0
    Comment actions Permalink
  • Avatar
    Member

    Hi Hilltops,

    thank for the feedback.

    Topaz does not simply insert a new mouth or nose here from other images. Rather, it reconstructs lost details from pixel-level details and the actual details of a mouth and nose (from collected data from millions of images). AI is doing here what our brains do. Just maybe not as well. But amazing what comes out. The image was a scan of an old analog image. I scanned it in low quality on purpose to see what the software would do with it. And the result is so close to the original that it's almost indistinguishable.

    I also tested other images with more resolution, taken from a digital camera. Again, the result was amazing. With architecture or with landscapes, many details became visible again.

    What you have to remember is that there is more to see on the pixel level than our eye can capture. Pixel level and the associated binary data can all be processed mathematically. And the more accurate the mathematical model used for this purpose, the better the result. An AI uses learned data from millions of other data (images) as a reference to establish order from a pixel mess.

    0
    Comment actions Permalink
  • Avatar
    Hilltops

    "Rather, it reconstructs lost details from pixel-level details and the actual details of a mouth and nose (from collected data from millions of images)." That's exactly the point I was making. Of course Topaz uses the structure of the original photo as starting point, hence the 'lookalike' I was talking about. 

    To be sure, I'm very happy that such technology is available and getting better and better. However, it's good to know what the underlying process entails. That's why I posted earlier. 

    0
    Comment actions Permalink
  • Avatar
    Member

    Hi Hilltops,

    you are right here, of course. I had misunderstood you a bit in your post...sorry.
    I just expected more from upscale AI, because the way it currently works is pointless. Because with any program I can enlarge an image with a pixel interpolation. And that's all upscale does. Actually, it's worse, because upscale causes some ugly artifacts, which are shown excellently on YouTube by Anthony Turnham, for example. He also compares with Topaz and finds a clear verdict here.

    Here is the link:
    https://youtu.be/AXdmj8U0fwI

    0
    Comment actions Permalink
  • Avatar
    Hilltops

    Yes, I saw it, but he also explains a probable reason why Topaz is better at this point in time. He also showed some results where Topaz' restoration was not so good. But to be sure, it's top-of-the-line.

     

    0
    Comment actions Permalink

Please sign in to leave a comment.