Unusual behaviour p...
 
Share:
Notifications
Clear all

15th Feb 2024: Astro Pixel Processor 2.0.0-beta29 released - macOS native File Chooser, macOS CMD-Q fixed, read-only Fits on network fixed and other bug fixes

7th December 2023:  added payment option Alipay to purchase Astro Pixel Processor from China, Hong Kong, Macau, Taiwan, Korea, Japan and other countries where Alipay is used.

 

Unusual behaviour processing Oiii lights

16 Posts
3 Users
1 Likes
648 Views
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

Hi. Been using APP for a couple of years now, with colour images form DSLR or OSC cameras.

Have just started with a monochrome camera; shooting narrowband on the Rosette, in Ha, Oiii and Sii.

Tried a quick test of each with only flats (just doing the darks/bias now) and the Ha went very well. However...

When I tried to process the Oiii lights (11 lights, 360s, minimum gain) both with and without the flats, the "analyse stars" step took at least an hour, each light taking 5-10 minutes. The rest of the stages went at a normal speed but the final integration was almost completely blank.

I've looked at the lights and can see stars in each of them, particularly the "ladder" of stars at the heart of the Rosette, so I'm scratching my head as to where this is going wrong. Any ideas? Happy to post the lights/flats if that helps...

Thanks!


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain Which camera and telescope are you using? Which filters? How long do you expose per sub for Ha? Did you load the Ha and OIII lights at the same time or did you first process the Ha and then the OIII separately?


   
ReplyQuote
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

@wvreeven Hi! I'm using an Altair 26MM, with an APM 100/800 refractor, and Altair narrowband filters. Each sub was for 360 seconds, and they were loaded (with their own flats) and done separately. No problem with the Ha and then huge problems with the Oiii.


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain Thanks for the info. Would you mind uploading, say, 5 subs of each Ha and OIII plus 5 each of the calibration files for each filter? See the upload instructions at the top right of any forum page. Please create a folder called daraobriain_oiii_slow and put the files there. Let me know when the upload is done and I'll have a look to see if I can find out what's going on. Thanks!

Oh and before I forget: what version of APP are you using?


   
ReplyQuote
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

Okay have opened a file under that name, and uploaded (in order) 5 Ha flats, 5 Ha lights, 5 Oiii Flats, 5 Oiii lights.

I'm using 1.083

Thanks for this!

D


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain Thanks very much. I'll probably have a look at the data tonight.


   
ReplyQuote
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

That's great. I'm just going to add two things to the mix. The first time I ran a test integration on Ha it gave a very pleasing result; but every time I run the same integration again I get a very blown out picture. I've added those results to the download; what am I doing wrong THERE? and how did I get it right the first time?

oh and when I tried to integrate my Sii lights, the star analysis went fine but I got the same blank result as the Oiii. There is a slim line on the Histogram but it was impossible to stretch into anything useful.

Thanks again. I've really enjoyed APP for the last two years, nit sure what I'm doing wrong here.

D


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain Dara, the files all are called very similarly (date and time in the filename only). Can you please either rename them or organize them in folders per type? That would considerably ease my investigation. Thanks very much in advance.


   
ReplyQuote
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

@wvreeven I've renamed them, so hopefully it is clearer now.


   
ReplyQuote
(@scotty38)
White Dwarf
Joined: 3 years ago
Posts: 17
 

Nice to see you here @daraobriain would love to see some of your images......


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain Sorry for the delay, I am quite busy at the moment.

I have taken a look at your data and I am afraid that several things are wrong with the Ha and OIII lights as well as the OIII flats.

First of all, all images have been recorded as "Flat Frame", even the lights. This is no issue per say because APP ignores the IMAGETYP FITS keyword. On top of that, the filter used is not recorded in the FITS header. Again not a problem per say because it is possible to load the images per filter and manually assign a filter to them. It merely is a lot of work.

Regarding the Ha lights, apart from what I wrote just above this, the signal looks very strange to me. It is almost as if the data has been clipped. This is clear from the histogram when I open one of the lights in APP:

Screenshot 2022 03 10 at 09.34.53

Instead of a smooth curve, there are very distinct spikes to the left (where the pixels with little signal are represented) and a more or less smooth (though still too spiky) distribution to the right (where the bright pixels are represented). This means that the faint nebulosity is lost and explains why the nebula seems to float on top of the sky background and why the sky background is so pitch black.

Regarding the OIII lights, apart from what I wrote just above this, there barely is any nebulosity in the frames and even barely any stars. The histogram looks slightly different from the Ha one, but still doesn't look correct:

Screenshot 2022 03 10 at 09.37.35

Again the faint signal, which contains all nebulosity in this case, has been lost and the sky looks way too black.

Regarding the flats, both the Ha and OIII flats look much better when it comes to the faint end of the histogram. Here the one for an Ha flat:

Screenshot 2022 03 10 at 09.45.56

and here for OIII:

Screenshot 2022 03 10 at 09.46.09

However, unfortunately, both don't look well for typical flats either. Both are very clearly clipped to the left. This means that there are lots of black pixels in (probably the corners and edges of) the flats and that means that in those places no flat correction can be performed. It essentially means that the flats are underexposed OR that your optical train has a huge vignetting. Also, the peak of the OIII flats is too far to the left. I see that you shot the Ha flats with gain 6982 but the OIII flats with gain 444 so you may want to up that latter one.

I am afraid that something went very wrong when you were shooting al the lights and flats. I am not familiar with Altair cameras nor with the AltairCapture software (which is mentioned in the FITS headers) so I am afraid I cannot help you further with that. Perhaps you could ask the Altair people for help using their software or at least finding out what the issue was with these images and flats? Sorry not to be able to be of more help.


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain Mabula, Vincent and I had another look at the data and they are all 8 bit. Please make sure to capture your data in 16 bit. This most likely is the cause of all troubles so give that a try and see if that solves the issue.


   
ReplyQuote
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

@wvreeven Thank you so much for looking at these!

I have been using Altair capture with an OSC for a year or two and I just presumed it would default to 16bit raw with the new camera. I will add that to the ever-growing checklist.

it was my first attempt at mono shooting, but even though the sensor is slightly larger, it’s surprising that there would suddenly be huge vignetting. I will also have to check the software for how it includes flats/lights and filters in the fits header information.

It was also my first time using a Pegasus flat master panel for the flats, but again, I’m scratching my head as to how that would lead to vignetting.

I presume the original problem, that the “star analyse” step was taking so long, was because there was so little information in the Oiii lights?

also, I presume that ideally, an hour of Oiii imaging of the Rosette should have SOME nebulously in the image?

as I mentioned in another post, the Sii images were similar to the Oiii, so something went strange when I swapped out the filters.

I’ll just have to do more experimenting next clear night I get.

thank you so much for looking at these; hopefully the next set will be more successful.

d

 


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 
Posted by: @daraobriain

I just presumed it would default to 16bit raw with the new camera.

I made exactly the same assumption and only when Mabula asked me to check that, I noticed that it was 8 bit data.

Posted by: @daraobriain

it was my first attempt at mono shooting, but even though the sensor is slightly larger, it’s surprising that there would suddenly be huge vignetting

I think my assessment about vignetting was wrong and this is because the data are 8 bit.

Posted by: @daraobriain

I presume the original problem, that the “star analyse” step was taking so long, was because there was so little information in the Oiii lights?

Correct. The number of stars simply is too small.

Posted by: @daraobriain

also, I presume that ideally, an hour of Oiii imaging of the Rosette should have SOME nebulously in the image?

Correct again. In general the OIII signal in emission nebulae is much weaker than the Ha emission but, given the strength of Ha in your subs, even a 360 sec light should show some nebulosity with OIII.

Posted by: @daraobriain

as I mentioned in another post, the Sii images were similar to the Oiii, so something went strange when I swapped out the filters.

The SII signal in emission nebulae is even weaker than OIII so you'll need a LOT of data to catch that. But again, given the signal strength of Ha in your subs, I would expect SII to show at least some nebulosity with 360 sec exposures. Mind that for both OIII and SII you may need to go up to 600 sec per sub.


   
ReplyQuote
(@daraobriain)
White Dwarf
Joined: 4 years ago
Posts: 14
Topic starter  

Hi, just to confirm, I went to test the camera and software today and yes, it defaults to 8 bit. So, I've redone all the darks and bias in 16 bit, and if I ever get a break in the cloud I'll try some lights again.

just to check though; presuming I actually do the images correctly this time...

when processing I do each filter in turn with corresponding flats, bias for the camera and darks depending on exposure time...

save each final stacked image as Fits file

then I clear everything...

and then I reload the three stacked fits files, register them together (to align) and then go to "combine RGB" and assign colours of each in turn to get my final image.

Is that, broad strokes, the order?

Thanks,

D


   
ReplyQuote
(@wvreeven)
Quasar
Joined: 6 years ago
Posts: 2133
 

@daraobriain That is one way of doing this, yes.

Another way is to load all lights into 1 session and to make sure to assign them to the correct filters. The same for the flats. Darks, dark flats and bias can be reused for all filters since those don't depend on light and therefore the filter has no influence on them. Then go straight to tab 6 and click the integrate button. That way you'll end up with the same 3 integration results and now they'll be aligned w.r.t. each other already.


   
ReplyQuote
Share: