Please come all to AstroFest in London to ask us (Mabula & Vincent) questions and to see live demos of APP!
2023-01-19: APP 2.0.0-beta13 has been released !
!!! Big performance increase due to optimizations in integration !!!
and upgraded development platform to GraalVM 22.3 based on openJDK19
We are very close now to releasing APP 2.0.0 stable with a complete printable manual...
[Solved] Huge temporaryDAT files
Hello, I have processed 3 sessions and the process took 12 hours to finish.
I see two temporary files which take 213Go and 106Go.. Is it normal?
I use an external HDD with USB3.
@albertderycke I have forwarded your question about the file sizes to Mabula.
A question for you. Is your external disk indeed an HDD or is it an SDD? HDDs are very slow in I/O and they slow down APP processing considerably. SDDs on the other hand are very fast. I use an SDD myself.
Thank you very much @wvreeven. It's a HDD so I'm aware about it's very slow but I have no choice at the moment because my Macbook internal SSD (But i'm on a Windows partition) has 256Go of capacity and the temporary files weight 300Go. So if the weight of the temporary files can be less heavy, I'll can use my internal SSD.
Yes it is normal, 12 hours is very long though, how many images did you process?
The temporary files are the layers of the Stack before the integration is complete. Once the integration is complete, the temp files will be deleted.
APP works like this, because we can then use Local Normalization Correction features. Going forward, it will also enable us to do dynamic deconvolution in the whole stack which will be really great...
The temp file of 213GB is for the regular data, the 106GB file is for the Multi-Band-Blending functionality.
I processed 130 lights and 50 Dark/Dark Flat/Flat
Too bad it takes up so much space because I don't have 300Go of internal SSD space... But's if it's normal and you can't reduce this temporary files, I let my process write on the external disk drive for half a day.
Thank you to read me.