Share:
Notifications
Clear all

19 June 2021: Our upload server https://upload.astropixelprocessor.com/ has been migrated successfully to our new office with higher upload and download speeds (nearly 10MByte/sec up/down ) ! We now have 1 general upload user called: upload with password: upload. The users upload1 - upload5 have been disabled.

31 May 2021: APP 1.083-beta2 has been released ! APP 1.083 stable will follow soon afterwards. It includes a completely new Star Reducer Tool, New File Saver Module, Improved Comet registration and much more, check the release notes here!

DOWNLOADS are available HERE!

 

[Solved] Huge temporaryDAT files  

  RSS

(@albertderycke)
Molecular Cloud Customer
Joined: 2 months ago
Posts: 3
September 5, 2021 07:25  

Hello, I have processed 3 sessions and the process took 12 hours to finish.

I see two temporary files which take 213Go and 106Go.. Is it normal?

I use an external HDD with USB3.

image

 Thank you.


ReplyQuote
Topic Tags
(@wvreeven)
Quasar Admin
Joined: 3 years ago
Posts: 1146
September 5, 2021 11:50  

@albertderycke I have forwarded your question about the file sizes to Mabula.

A question for you. Is your external disk indeed an HDD or is it an SDD? HDDs are very slow in I/O and they slow down APP processing considerably. SDDs on the other hand are very fast. I use an SDD myself.


ReplyQuote
(@albertderycke)
Molecular Cloud Customer
Joined: 2 months ago
Posts: 3
September 5, 2021 12:03  

Thank you very much @wvreeven. It's a HDD so I'm aware about it's very slow but I have no choice at the moment because my Macbook internal SSD (But i'm on a Windows partition) has 256Go of capacity and the temporary files weight 300Go. So if the weight of the temporary files can be less heavy, I'll can use my internal SSD.

This post was modified 2 months ago by Albert Derycke

ReplyQuote
(@mabula-admin)
Universe Admin
Joined: 5 years ago
Posts: 2729
September 6, 2021 22:20  

Hi Albert @albertderycke & @wvreeven,

Yes it is normal, 12 hours is very long though, how many images did you process?

The temporary files are the layers of the Stack before the integration is complete. Once the integration is complete, the temp files will be deleted.

APP works like this, because we can then use Local Normalization Correction features. Going forward, it will also enable us to do dynamic deconvolution in the whole stack which will be really great...

The temp file of 213GB is for the regular data, the 106GB file is for the Multi-Band-Blending functionality.


ReplyQuote
(@albertderycke)
Molecular Cloud Customer
Joined: 2 months ago
Posts: 3
September 7, 2021 19:29  

Hi @mabula-admin 

I processed 130 lights and 50 Dark/Dark Flat/Flat

Too bad it takes up so much space because I don't have 300Go of internal SSD space... But's if it's normal and you can't reduce this temporary files, I let my process write on the external disk drive for half a day.

Thank you to read me.

 


ReplyQuote
Share: