Sky Replacement masking
Answered
I have noticed that sometimes the Sky Replacement functionality fails to properly mask the entire sky so the replacement sky often contains sections of the old sky, leaving the replacement looking like a bad replacement.
I am not referring to areas full of leaves or other foliage, but clearly part of the sky that has not been selected to be replaced, andI can not find a way to add that part of the image to the sky mask. Adjusting the replacement sky using the controls does not help since the old sky that was not removed can not be adjusted.
It would be very helpful if there was some way to manually adjust the selected sky area so that the replacement sky looks correct.
I have attached 3 images showing the issue. The first is the original image showing the areas that are not selected in a sky replacement, the second is the same image with the sky replacement and the third shows the mask. All have been marked to show the areas that are not being selected for removal.
-
The same issue exists for the masking AI. Here is the same image where I have selected the Architecture control in Mask AI in the Develop Control. I had planned to adjust the display of the trailers but as you can see the masking failed to select the entire trailer structure.
I am not complaining about the masking itself. It is new functionality and I am sure it will improve, but as it is now there seems to be no way to adjust what is selected.
-
Hi Michael,
to the first pronlem with the Sky Replacement. I wonder, because the sky is very simple structure. With the Sky Replacement tool I never had a problem even with such skies. Only with complicated skies with a lot of details (fine leaf structures) there were problems now and then.
It can happen that deeper gaps are not properly filled by the new sky, but you can move the sky down and also close the gaps. With this, at least for me, it has worked without problems in almost all cases so far.Be sure to use the Sky Replacement Tool for the sky replacement, not the masking function. The Sky Replacement Tool is much more accurate.
On the other hand, the AI masking function in the sky detection (also other objects like architecture) is sometimes very inaccurate. Here you have to rework with the brush. It would be desirable here that the brush has an edge detection. But this is missing, so you have to work very precisely with the brush. But it works with a little practice.
-
> you can move the sky down and also close the gaps.
Parts of the sky were not included in the Sky Replacement selection by Neo, so moving the sky down does not help. The white sections stay white.
> Be sure to use the Sky Replacement Tool for the sky replacement, not the masking function.
The first 2 photos were the results when using the Sky Replacement functionality. Not the masking functionality. I added the 3rd image to show what the masking functionality had missed when trying to select the sky.
> Here you have to rework with the brush.
My post here was to point out that if someone is using the Masking AI functionality there is no way to modify the selected mask. Or at least no way I could find. I am suggesting that the developers add some way to use the Masking AI functionality and then be able to use the manual masking to correct what the AI masked.
The alternative is to do all of the masking manually and while I can do that it seems silly because the AI functionality has already done most of it. It would be easiest if I could then do some manual adjusting of what the AI has already done.
-
FWIW:
I found that while there is no way to adjust the mask created by Mask AI when you make the original mask, you can later go into the Edits part of the Tools/Edits sidebar, open up the appropriate entry and use the Brush setting to adjust the mask that was created by Mask AI, and that is also true of the Sky mask, so it is possible to do what I wanted to do, although it apparently can not be done when originally creating the mask.
-
Just curious, in the example you posted above did you use the Refinement tools?
-
Hi Michael!
Could you please send us the original files you were trying to process this way? We'd like to use them for our AI algorithms training. Here's how you can send us the files
- Visit https://wetransfer.com/
- If it's your first time visiting this website, it might ask you to purchase a subscription. Simply select to proceed with the free version.
- Click Add your files.
- Select the file(s) on your computer.
- After you see all the files you need to send appear in the list, click the icon to the left of the Transfer button (the icon looks like a circle with three dots in it).
- In Send As select Link.
- Click Transfer.
- After the files have finished uploading, click Copy Link and paste it into your support request at https://skylum.com/support
Looking forward to hearing from you.
-
All done. I have uploaded 3 images. One is the HDR image (made with the Neo extension) that I used in the posting. The other two are one normal exposure images used in the HDR merge, one a raw image and the other a jpg. All exhibit the same issue when used with the Mask AI functionality in the Sky dialog.
-
Michael Sonshine, please contact us at https://skylum.com/support, and we'll send you an alternative link then.
Please sign in to leave a comment.
Comments
12 comments