Share:
Notifications
Clear all

[Solved] Huge temporaryDAT files


(@albertderycke)
Hydrogen Atom Customer
Joined: 9 months ago
Posts: 3
Topic starter  

Hello, I have processed 3 sessions and the process took 12 hours to finish.

I see two temporary files which take 213Go and 106Go.. Is it normal?

I use an external HDD with USB3.

image

 Thank you.


ReplyQuote
Topic Tags
(@wvreeven)
Galaxy Admin
Joined: 4 years ago
Posts: 1651
 

@albertderycke I have forwarded your question about the file sizes to Mabula.

A question for you. Is your external disk indeed an HDD or is it an SDD? HDDs are very slow in I/O and they slow down APP processing considerably. SDDs on the other hand are very fast. I use an SDD myself.


ReplyQuote
(@albertderycke)
Hydrogen Atom Customer
Joined: 9 months ago
Posts: 3
Topic starter  

Thank you very much @wvreeven. It's a HDD so I'm aware about it's very slow but I have no choice at the moment because my Macbook internal SSD (But i'm on a Windows partition) has 256Go of capacity and the temporary files weight 300Go. So if the weight of the temporary files can be less heavy, I'll can use my internal SSD.

This post was modified 9 months ago by Albert Derycke

ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 5 years ago
Posts: 3122
 

Hi Albert @albertderycke & @wvreeven,

Yes it is normal, 12 hours is very long though, how many images did you process?

The temporary files are the layers of the Stack before the integration is complete. Once the integration is complete, the temp files will be deleted.

APP works like this, because we can then use Local Normalization Correction features. Going forward, it will also enable us to do dynamic deconvolution in the whole stack which will be really great...

The temp file of 213GB is for the regular data, the 106GB file is for the Multi-Band-Blending functionality.


ReplyQuote
(@albertderycke)
Hydrogen Atom Customer
Joined: 9 months ago
Posts: 3
Topic starter  

Hi @mabula-admin 

I processed 130 lights and 50 Dark/Dark Flat/Flat

Too bad it takes up so much space because I don't have 300Go of internal SSD space... But's if it's normal and you can't reduce this temporary files, I let my process write on the external disk drive for half a day.

Thank you to read me.

 


ReplyQuote
Share: