Help needed, still can't get Flats to work correctly
I posted about my issue a few weeks ago and thought I had figured it out. But based on my latest processing attempts clearly I have not. My issue is when I include the flat files I took at the same time I captured my lights they are over correcting the image. Dust motes go from being dark spots to bright spots, and the vignetting in the corners also goes from being dark to bright. I have gone through the complete calibration workflow multiple times and the results are always the same. I tried creating the master flat first, calibrated with the darks, bias and bad pixel map. Then I tried all the files at the same time. No matter what I do the final image looks like the master flat is being applied either to strongly, or more than once.
Below is an integration that shows the image results when the flats are included:
I have uploaded all data used to create the image in a tar.gz format. Included are the lights, darks, flats, master bias and bad pixel map. If I can't get to the bottom of this issue I will be forced to use something other than APP to process my images. Thanks for any help.
Update, I tried stacking my data with DSS, and got the same result as the APP image, washed out corners and the dust motes are bright spots. I also took some test flats today via SGP saved as fits files to eliminate that as a possible cause of the issue. Again I got the same results, with the flats 'over correcting' the lights. Clearly the issue is not related to APP, its something with my data or the flats themselves.
My flats exposure was set to place the image histogram at around 50%, which is what I have read is correct. I would appreciate any ideas on what is causing my issues.
Sorry for the delay Scott, had my parents come over to New Zealand so was out of the usual forum activity. 😉 Yes, thanks for analyzing it a bit further yourself. If other programs show the same, it must be the data indeed (I would have expected that already as there doesn't seem to be a huge problem or bug for the flat workflow). 50% of the histogram should be correct yes, given you look at a linear histogram. So in SGP for example (which always works on 16-bit no matter what camera you use) you aim for an ADU value of about 30.000. Is that what you do?
Vincent, thanks for the reply. I believe the entire issue was due to Sequence Generator Pro saving the lights as .fits files (default setting), while my flats were stored as Nikon Raw .NEF format. I found out over at the CN forum that I could set SGP to save all images as .NEF instead of .fits. I imaged M15 and saved my lights, darks and flats as .NEF. I had no problem in APP with the flats and this new dataset, so problem solved going forward.
I do have another question you might be able to answer. When I take my flats and look at the back of camera histogram all 3 color channels are similar at around 50%, and the image is a mid gray color. However, when I read those files into APP, the red is always at a much lower value (25%), blue in the middle and green at close to 75%. The images render in APP as green/blue, instead of gray as expected. I assume the difference comes down to APP displaying linear data, while the camera applies some type of gamma correction that raises the red levels? Do you know what is going on and is this common?