Sky Replacement masking

Answered

Comments

12 comments

  • Avatar
    Michael Sonshine

    The same issue exists for the masking AI. Here is the same image where I have selected the Architecture control in Mask AI in the Develop Control. I had planned to adjust the display of the trailers but as you can see the masking failed to select the entire trailer structure.

    I am not complaining about the masking itself. It is new functionality and I am sure it will improve, but as it is now there seems to be no way to adjust what is selected.

    0
    Comment actions Permalink
  • Avatar
    Member

    Hi Michael,

    to the first pronlem with the Sky Replacement. I wonder, because the sky is very simple structure. With the Sky Replacement tool I never had a problem even with such skies. Only with complicated skies with a lot of details (fine leaf structures) there were problems now and then.
    It can happen that deeper gaps are not properly filled by the new sky, but you can move the sky down and also close the gaps. With this, at least for me, it has worked without problems in almost all cases so far.

    Be sure to use the Sky Replacement Tool for the sky replacement, not the masking function. The Sky Replacement Tool is much more accurate.

    On the other hand, the AI masking function in the sky detection (also other objects like architecture) is sometimes very inaccurate. Here you have to rework with the brush. It would be desirable here that the brush has an edge detection. But this is missing, so you have to work very precisely with the brush. But it works with a little practice.

    0
    Comment actions Permalink
  • Avatar
    Michael Sonshine

    > you can move the sky down and also close the gaps.

    Parts of the sky were not included in the Sky Replacement selection by Neo, so moving the sky down does not help. The white sections stay white.

    > Be sure to use the Sky Replacement Tool for the sky replacement, not the masking function. 

    The first 2 photos were the results when using the Sky Replacement functionality. Not the masking functionality. I added the 3rd image to show what the masking functionality had missed when trying to select the sky.

    > Here you have to rework with the brush.

    My post here was to point out that if someone is using the Masking AI functionality there is no way to modify the selected mask. Or at least no way I could find. I am suggesting that the developers add some way to use the Masking AI functionality and then be able to use the manual masking to correct what the AI masked.

    The alternative is to do all of the masking manually and while I can do that it seems silly because the AI functionality has already done most of it. It would be easiest if I could then do some manual adjusting of what the AI has already done.

     

    0
    Comment actions Permalink
  • Avatar
    Michael Sonshine

    FWIW:

    I found that while there is no way to adjust the mask created by Mask AI when you make the original mask, you can later go into the Edits part of the Tools/Edits sidebar, open up the appropriate entry and use the Brush setting to adjust the mask that was created by Mask AI, and that is also true of the Sky mask, so it is possible to do what I wanted to do, although it apparently can not be done when originally creating the mask.

     

    0
    Comment actions Permalink
  • Avatar
    Member

    Very good. Each mask can be edited manually. Then your problem should be solved.

    0
    Comment actions Permalink
  • Avatar
    Howard Lebowitz

    Michael Sonshine

    Just curious, in the example you posted above did you use the Refinement tools?

    0
    Comment actions Permalink
  • Avatar
    Michael Sonshine

    Yes, I did. But they did not help much. The area of the sky that was not included in the sky mask was so large that the Close Gaps adjustment had no visible effect.

    0
    Comment actions Permalink
  • Avatar
    Michael Sonshine

    Just as an aside, the old Sky Replacement functionality worked properly with this image. There was no white area that was missed, as there was with the Mask AI functionality.

    Just seems curious to me that the old functionality worked properly while the new did not.

     

    0
    Comment actions Permalink
  • Avatar
    Tania Taylor

    Hi Michael!

    Could you please send us the original files you were trying to process this way? We'd like to use them for our AI algorithms training. Here's how you can send us the files

    1. Visit https://wetransfer.com/
    2. If it's your first time visiting this website, it might ask you to purchase a subscription. Simply select to proceed with the free version.
    3. Click Add your files.
    4. Select the file(s) on your computer.
    5. After you see all the files you need to send appear in the list, click the icon to the left of the Transfer button (the icon looks like a circle with three dots in it).
    6. In Send As select Link.
    7. Click Transfer.
    8. After the files have finished uploading, click Copy Link and paste it into your support request at https://skylum.com/support

    Looking forward to hearing from you.

    0
    Comment actions Permalink
  • Avatar
    Michael Sonshine

    All done. I have uploaded 3 images. One is the HDR image (made with the Neo extension) that I used in the posting. The other two are one normal exposure images used in the HDR merge, one a raw image and the other a jpg. All exhibit the same issue when used with the Mask AI functionality in the Sky dialog.

    0
    Comment actions Permalink
  • Avatar
    Tania Taylor

    Michael Sonshine, please contact us at https://skylum.com/support, and we'll send you an alternative link then.

    0
    Comment actions Permalink
  • Avatar
    Michael Sonshine

    I got it figured out, and have uploaded and sent the images to retransfer. I have also created the support request and included the link.

     

    0
    Comment actions Permalink

Please sign in to leave a comment.