Huge temporaryDAT f...
 
Share:
Notifications
Clear all

UPDATE FROM MABULA

I have had a very rough 2 months unfortunately health wise. I was struck 3x in a row with bacterial infections. The second infection occurred  after a routine hospital checkup and I became very sick. I had to rest and take a lot of antibiotics. Once I was recovering and restarting work 1 month ago, I again became sick. The infection was not yet gone, so even more antibiotics and rest was needed. Needless to say, it took a lot of my energy and I needed a lot of rest.

 

Finally, the infection is really gone and my energy is coming back step-by-step now and I have started work again. I am terribly sorry to have kept you waiting for support. I will address all outstanding questions and e-mails step-by step and will be on the forum daily from today.

 

APP 2.0.0-beta47 will come soon as well, a lot of work was already completed before I became very ill, so the release is also nearly ready for you. Beta47 will be much faster actually. Many workflows will be more than 2x faster, mosaics can even be 10x faster than before because registration really received a major boost... all compared to beta46.  Before I release it, I will make sure that everything is working properly and then I will release it.

[Solved] Huge temporaryDAT files

5 Posts
3 Users
0 Reactions
3,734 Views
(@albertderycke)
Molecular Cloud
Joined: 5 years ago
Posts: 3
Topic starter  

Hello, I have processed 3 sessions and the process took 12 hours to finish.

I see two temporary files which take 213Go and 106Go.. Is it normal?

I use an external HDD with USB3.

image

 Thank you.



   
ReplyQuote
Topic Tags
(@wvreeven)
Quasar
Joined: 8 years ago
Posts: 2134
 

@albertderycke I have forwarded your question about the file sizes to Mabula.

A question for you. Is your external disk indeed an HDD or is it an SDD? HDDs are very slow in I/O and they slow down APP processing considerably. SDDs on the other hand are very fast. I use an SDD myself.



   
ReplyQuote
(@albertderycke)
Molecular Cloud
Joined: 5 years ago
Posts: 3
Topic starter  

Thank you very much @wvreeven. It's a HDD so I'm aware about it's very slow but I have no choice at the moment because my Macbook internal SSD (But i'm on a Windows partition) has 256Go of capacity and the temporary files weight 300Go. So if the weight of the temporary files can be less heavy, I'll can use my internal SSD.


This post was modified 5 years ago by Albert Derycke

   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 9 years ago
Posts: 5379
 

Hi Albert @albertderycke & @wvreeven,

Yes it is normal, 12 hours is very long though, how many images did you process?

The temporary files are the layers of the Stack before the integration is complete. Once the integration is complete, the temp files will be deleted.

APP works like this, because we can then use Local Normalization Correction features. Going forward, it will also enable us to do dynamic deconvolution in the whole stack which will be really great...

The temp file of 213GB is for the regular data, the 106GB file is for the Multi-Band-Blending functionality.



   
ReplyQuote
(@albertderycke)
Molecular Cloud
Joined: 5 years ago
Posts: 3
Topic starter  

Hi @mabula-admin 

I processed 130 lights and 50 Dark/Dark Flat/Flat

Too bad it takes up so much space because I don't have 300Go of internal SSD space... But's if it's normal and you can't reduce this temporary files, I let my process write on the external disk drive for half a day.

Thank you to read me.

 



   
ReplyQuote
Share: