19 June 2021: Our upload server https://upload.astropixelprocessor.com/ has been migrated successfully to our new office with higher upload and download speeds (nearly 10MByte/sec up/down ) ! We now have 1 general upload user called: upload with password: upload. The users upload1 - upload5 have been disabled.
31 May 2021: APP 1.083-beta2 has been released ! APP 1.083 stable will follow soon afterwards. It includes a completely new Star Reducer Tool, New File Saver Module, Improved Comet registration and much more, check the release notes here!
[Solved] Huge temporaryDAT files
Hello, I have processed 3 sessions and the process took 12 hours to finish.
I see two temporary files which take 213Go and 106Go.. Is it normal?
I use an external HDD with USB3.
@albertderycke I have forwarded your question about the file sizes to Mabula.
A question for you. Is your external disk indeed an HDD or is it an SDD? HDDs are very slow in I/O and they slow down APP processing considerably. SDDs on the other hand are very fast. I use an SDD myself.
Thank you very much @wvreeven. It's a HDD so I'm aware about it's very slow but I have no choice at the moment because my Macbook internal SSD (But i'm on a Windows partition) has 256Go of capacity and the temporary files weight 300Go. So if the weight of the temporary files can be less heavy, I'll can use my internal SSD.
Yes it is normal, 12 hours is very long though, how many images did you process?
The temporary files are the layers of the Stack before the integration is complete. Once the integration is complete, the temp files will be deleted.
APP works like this, because we can then use Local Normalization Correction features. Going forward, it will also enable us to do dynamic deconvolution in the whole stack which will be really great...
The temp file of 213GB is for the regular data, the 106GB file is for the Multi-Band-Blending functionality.
I processed 130 lights and 50 Dark/Dark Flat/Flat
Too bad it takes up so much space because I don't have 300Go of internal SSD space... But's if it's normal and you can't reduce this temporary files, I let my process write on the external disk drive for half a day.
Thank you to read me.