1.077 - Calibration...
 
Share:
Notifications
Clear all

Mar 28 2026 APP 2.0.0-beta40 will be released in 7 days.

It did take a long time to have the work finished on this and it  will have a major performance boost of 30-50% over 2.0.0-beta39 from calibration to integration. We extensively optimized many critical parts of APP. All has been tested to guarantee correct optimizations. Drizzle and image resampling is much faster for instance, those modules have been completely rewritten. Much less memory usage. LNC 2.0 will be released which works much better and faster than LNC in it's current state. And more, all will be added to the release notes in the coming weeks...

Update on the 2.0.0 release & the full manual

We are getting close to the 2.0.0 stable release and the full manual. The manual will soon become available on the website and also in PDF format. Both versions will be identical and once released, will start to follow the APP release cycle and thus will stay up-to-date to the latest APP version.

Once 2.0.0 is released, the price for APP will increase. Owner's license holders will not need to pay an upgrade fee to use 2.0.0, neither do Renter's license holders.

 

[Solved] 1.077 - Calibration Error Warning But Needed Files are Present

12 Posts
3 Users
0 Reactions
2,897 Views
(@rowland-f-archer-jr)
Neutron Star
Joined: 9 years ago
Posts: 89
Topic starter  

Hi Mabula,

I installed 1.077 and got the calibration error saying flats could not be calibrated correctly without a bias, or dark-flat, or both of the correct gain and offset, etc.   This was using multi-filter, single session, 140 flats - 20 each L, R, G, B, S, H, O.  Master Darks, Master Flat Darks, Master Bias, BPM loaded with matching offset and gain.  I use 139 / 50 for gain /offset for LRGB, and 200/50 for SHO.  When loading the master calibration files I specified that they should be used with the appropriate filters.  E.g., there were two BPM files loaded, one 139/50 and 200/50, but I specified the 139/50 was for LRGB and the 200/50 was for SHO.   Same for the master darks/flat darks/ bias.

I loaded the same files in 1.075 and it works OK with no warnings, so I'm back to 1.075 for now.

Do I need to build new master dark / flat dark/ bias / bpm with 1.077?  

Thanks,

Rowland


This topic was modified 6 years ago by Mabula-Admin

   
ReplyQuote
(@Anonymous 174)
Joined: 9 years ago
Posts: 5702
 

No, you don't need to rebuilt anything. I'll notify Mabula of this, maybe we can replicate this potential issue. Thanks for reporting!



   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 9 years ago
Posts: 5056
 

Hi Rowland @rowland-f-archer-jr,

First of all, BPMs are not gain / offset, exposure, temperature dependent, so there is no need to use different BPMs if you are calibrating data from the same camera.

I think I can only reproduce your problem if you upload some of your lights for the L, R, G, B, S, H, O filters and their masters to calibrate them.

Nothing has changed in this regard between 1.075 and 1.077 so are you 100% sure that you loaded everything correctly when processing in 1.077 ?

You can upload it here and I will have a look as soon as possible:

https://ariesprodstor.astropixelprocessor.com:7001/

login and password: appuser

Thanks,

Mabula



   
ReplyQuote
(@rowland-f-archer-jr)
Neutron Star
Joined: 9 years ago
Posts: 89
Topic starter  

@mabula-admin

I'm never sure about anything 🙂

I did inspect things and they looked OK, and to the best of my knowledge I reloaded the same data into 1.075 and no warnings.  It makes sense that the BPM is independent of gain and offset.  I just have a set of my "current calibration files" for each gain/offset/temperature combination and load them all.

I'll try to reproduce with a small data set and upload if successful in doing so.  Right now 1.075 is processing a large data set so it will be a little while before I can do this.  Thanks!

Rowland



   
ReplyQuote
(@rowland-f-archer-jr)
Neutron Star
Joined: 9 years ago
Posts: 89
Topic starter  

I was able to reproduce the problem with a small file set which I am uploading now.

Workflow (all program defaults except where noted)

0) Choose Multi-Channel/Filter processing

1)  Load the five H and five G flat files with the Flat button, selecting "use filter name in header" option

2)  Load the contents of the Gain 139 Off 50 folder using the MasterDark button, selecting "G" as the filter to which they apply

3)  Load the contents of the Gain 200 Off 50 folder using the MasterDark button, selecting "H" as the filter to which they apply

4) Select "Scale MasterDarkFlat" in the Calibrate tab 

5)  Click "Create Masters and Assign to Lights" button and get this warning:

image

Click OK and it proceeds but doesn't leave me feeling confident that it's working.

No warning with 1.075 with same files and settings.

Thanks,

Rowland

 



   
ReplyQuote
(@Anonymous 174)
Joined: 9 years ago
Posts: 5702
 

Thanks Rowland! We'll have a look at it.



   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 9 years ago
Posts: 5056
 
Posted by: @rowland-f-archer-jr

I was able to reproduce the problem with a small file set which I am uploading now.

Workflow (all program defaults except where noted)

0) Choose Multi-Channel/Filter processing

1)  Load the five H and five G flat files with the Flat button, selecting "use filter name in header" option

2)  Load the contents of the Gain 139 Off 50 folder using the MasterDark button, selecting "G" as the filter to which they apply

3)  Load the contents of the Gain 200 Off 50 folder using the MasterDark button, selecting "H" as the filter to which they apply

4) Select "Scale MasterDarkFlat" in the Calibrate tab 

5)  Click "Create Masters and Assign to Lights" button and get this warning:

image

Click OK and it proceeds but doesn't leave me feeling confident that it's working.

No warning with 1.075 with same files and settings.

Thanks,

Rowland

 

Dear Rowland @rowland-f-archer-jr,

Thank you very much, I will check it tomorrow 😉

But... from your workflow, I think I can already guess why it goes wrong though...

Let me explain: you are  enabling to scale the MasterDarkFlat, probably, because it does not match the flats, right?Why else use scaling.

But you don't provide bias/masterbias. Scaling can only be done when you provide bias/masterbias, so scaling can't be done and thus the provided calibration data warrants a warning, (the contents, in this case, can be more clear). I will check tomorrow though.

Mabula



   
ReplyQuote
(@rowland-f-archer-jr)
Neutron Star
Joined: 9 years ago
Posts: 89
Topic starter  

Hi Mabula,

You are correct about why I am scaling the MasterDarkFlat - but I did include a MasterBias, as you will see when you look at the uploaded file.   I just use the MasterDark button and select all my calibration files.  APP automatically recognizes the MasterBias and puts it in the right place.

All the best,

Rowland


This post was modified 6 years ago by Rowland F Archer Jr

   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 9 years ago
Posts: 5056
 

@rowland-f-archer-jr

Hi Rowland,

If you load the masterbiass, masterdarks and BPMs for all channels it works as expected. The right ones are matched because APP will match them on the gain value.

As soon as you load those masters for a specific filter, then a bug is indeed triggered:

Bug filter assignment

As you can see, the flats have H & G as filters, and the masters have Green and Hydorgen-alpha, because of this they are not matched... I will fix this a.s.a.p

Again you trigger a bug by using filter assignments of only 1 letter ;-), should work though... 😉

Thanks again for reporting.

Mabula


This post was modified 6 years ago by Mabula-Admin

   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 9 years ago
Posts: 5056
 
Posted by: @rowland-f-archer-jr

Hi Mabula,

You are correct about why I am scaling the MasterDarkFlat - but I did include a MasterBias, as you will see when you look at the uploaded file.   I just use the MasterDark button and select all my calibration files.  APP automatically recognizes the MasterBias and puts it in the right place.

All the best,

Rowland

Thanks Rowland @rowland-f-archer-jr,

I have fixed it, it now works properly :

Bug filter assignment fixed

You will not get a critical calibration warning next time (I hope... 😉 ), the one-letter filter assignments are converted to a logical full name for both the flats and the masters and then matching works correctly. Scaling is enabled as well and applied because the masterbias is assigned as well.

I will soon release a 1.078 beta version so you can test 😉

Mabula



   
ReplyQuote
(@rowland-f-archer-jr)
Neutron Star
Joined: 9 years ago
Posts: 89
Topic starter  

Thanks Mabula.  

As far as I remember I've always used single letter filter names.  Maybe the names were converted to longer ones internally when the masters were created.

If I ignore the warning in 1.077, is the calibration still carried out correctly, or should I use 1.075 until 1.078 beta is released?



   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 9 years ago
Posts: 5056
 
Posted by: @rowland-f-archer-jr

Thanks Mabula.  

As far as I remember I've always used single letter filter names.  Maybe the names were converted to longer ones internally when the masters were created.

If I ignore the warning in 1.077, is the calibration still carried out correctly, or should I use 1.075 until 1.078 beta is released?

Hi Rowland @rowland-f-archer-jr,

If it looks like this,

Bug filter assignment

then matching will not work and thus you will get a warning (which is a good thing here).

 

You can still use 1.077, but when you load the frames, don't use the filter header tag but choose the preset filter names as provided like Green and Hydrogen-Alpha, then all should work fine.

If you persist on using the filter header tag when loading the frames, then it is best to go back to 1.075 for now and wait for my new beta release. Think that will be provided within 1-2 days time.

 

Mabula



   
ReplyQuote
Share: