Huge temporaryDAT f...
 
Share:
Notifications
Clear all

2023-09-28: APP 2.0.0-beta24 has been released !

 

Improved application startup, fixed application startup issues, upgraded development platform to Oracle GraalVM JDK21

We are very close now to  releasing APP 2.0.0 stable with a complete printable manual...

Astro Pixel Processor Windows 64-bit

Astro Pixel Processor macOS Intel 64-bit

Astro Pixel Processor macOS Apple M Silicon 64-bit

Astro Pixel Processor Linux DEB 64-bit

Astro Pixel Processor Linux RPM 64-bit

[Solved] Huge temporaryDAT files

5 Posts
3 Users
0 Likes
1,181 Views
(@albertderycke)
Molecular Cloud
Joined: 2 years ago
Posts: 3
Topic starter  

Hello, I have processed 3 sessions and the process took 12 hours to finish.

I see two temporary files which take 213Go and 106Go.. Is it normal?

I use an external HDD with USB3.

image

 Thank you.


   
ReplyQuote
Topic Tags
(@wvreeven)
Quasar
Joined: 5 years ago
Posts: 2119
 

@albertderycke I have forwarded your question about the file sizes to Mabula.

A question for you. Is your external disk indeed an HDD or is it an SDD? HDDs are very slow in I/O and they slow down APP processing considerably. SDDs on the other hand are very fast. I use an SDD myself.


   
ReplyQuote
(@albertderycke)
Molecular Cloud
Joined: 2 years ago
Posts: 3
Topic starter  

Thank you very much @wvreeven. It's a HDD so I'm aware about it's very slow but I have no choice at the moment because my Macbook internal SSD (But i'm on a Windows partition) has 256Go of capacity and the temporary files weight 300Go. So if the weight of the temporary files can be less heavy, I'll can use my internal SSD.

This post was modified 2 years ago by Albert Derycke

   
ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 6 years ago
Posts: 3876
 

Hi Albert @albertderycke & @wvreeven,

Yes it is normal, 12 hours is very long though, how many images did you process?

The temporary files are the layers of the Stack before the integration is complete. Once the integration is complete, the temp files will be deleted.

APP works like this, because we can then use Local Normalization Correction features. Going forward, it will also enable us to do dynamic deconvolution in the whole stack which will be really great...

The temp file of 213GB is for the regular data, the 106GB file is for the Multi-Band-Blending functionality.


   
ReplyQuote
(@albertderycke)
Molecular Cloud
Joined: 2 years ago
Posts: 3
Topic starter  

Hi @mabula-admin 

I processed 130 lights and 50 Dark/Dark Flat/Flat

Too bad it takes up so much space because I don't have 300Go of internal SSD space... But's if it's normal and you can't reduce this temporary files, I let my process write on the external disk drive for half a day.

Thank you to read me.

 


   
ReplyQuote
Share: