More virtual memory...
 
Share:
Notifications
Clear all

15th Feb 2024: Astro Pixel Processor 2.0.0-beta29 released - macOS native File Chooser, macOS CMD-Q fixed, read-only Fits on network fixed and other bug fixes

7th December 2023:  added payment option Alipay to purchase Astro Pixel Processor from China, Hong Kong, Macau, Taiwan, Korea, Japan and other countries where Alipay is used.

 

More virtual memory?

21 Posts
2 Users
2 Likes
2,642 Views
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

Hey guys and girls,

I tried to combine 2 sessiones (trial version for pre-buy-testing).

At the final last steps it ran out of memory an requested ~100000000 kb.

I have 16 GB RAM inside(10 free for APP; 1-2 more possible), so I think it works with virtual RAM.

Do I have to set Java on some commands or is it possible to do in APP?

Thanks for APP, Sven

 


   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Usually this is handled by the OS itself, APP doesn't actively implement virtual memory. What OS do you use?


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

@vincent-mod

My OS is:

Win 10 Pro 64 bit 6.2.9200

Java 64 bit Vers. 8.0.2410.7

 

On this system:

Computer:
      Computertyp                                       ACPI x64-basierter PC
      Betriebssystem                                    Windows 10 Enterprise Professional
      OS Service Pack                                   -
      Internet Explorer                                 9.11.18362.0
      DirectX                                           DirectX 12.0
      Computername                                      FAMILIE-GAMER
      Benutzername                                      T3chN0H311
      Domainanmeldung                                   Familie-Gamer
      Datum / Uhrzeit                                   2020-07-18 / 09:06

    Motherboard:
      CPU Typ                                           4x , 3200 MHz
      Motherboard Name                                  Unbekannt
      Motherboard Chipsatz                              Unbekannt
      Arbeitsspeicher                                   16289 MB
      BIOS Typ                                          AMI (04/13/12)
      Anschlüsse (COM und LPT)                          Kommunikationsanschluss (COM1)

    Anzeige:
      Grafikkarte                                       GeForce GTX 1060 3GB  (3072 MB)
      Grafikkarte                                       GeForce GTX 1060 3GB  (3072 MB)
      Grafikkarte                                       GeForce GTX 1060 3GB  (3072 MB)
      Grafikkarte                                       GeForce GTX 1060 3GB  (3072 MB)
      Monitor                                           PnP-Monitor (Standard) [NoDB]  (ETT2L0056604U)
      Monitor                                           PnP-Monitor (Standard) [NoDB]  (H4MCA00390)

    Multimedia:
      Soundkarte                                        High Definition Audio-Controller [10DE-10F1] [NoDB]
      Soundkarte                                        High Definition Audio-Controller [8086-8C20] [NoDB]
      Soundkarte                                        SB Recon3D PCIe Audio Controller [1102-0012] [NoDB]

    Datenträger:
      IDE Controller                                    Intel(R) 8 Series/C220 Chipset Family SATA AHCI Controller
      Massenspeicher Controller                         Microsoft-Controller für Speicherplätze
      Festplatte                                        Generic- Compact Flash USB Device
      Festplatte                                        Generic- MS/MS-Pro USB Device
      Festplatte                                        Generic- SD/MMC USB Device
      Festplatte                                        Generic- SM/xD-Picture USB Device
      Festplatte                                        Samsung SSD 840 EVO 120G SCSI Disk Device  (111 GB)
      Festplatte                                        Samsung SSD 850 EVO 120G SCSI Disk Device  (111 GB)
      Festplatte                                        WD Elements 25A2 USB Device  (931 GB, USB)
      Festplatte                                        WDC WD10EZEX-22BN5A0 SCSI Disk Device  (931 GB)
      Festplatte                                        WDC WD10EZEX-22BN5A0 SCSI Disk Device  (931 GB)
      Optisches Laufwerk                                HL-DT-ST DVDRAM GH24NSB0 SCSI CdRom Device
      S.M.A.R.T. Festplatten-Status                     OK

    Partitionen:
      C: (NTFS)                                         111.2 GB (66.8 GB frei)
      D: (NTFS)                                         931.4 GB (506.3 GB frei)
      E: (NTFS)                                         931.5 GB (315.2 GB frei)
      F: (NTFS)                                         111.8 GB (100.8 GB frei)
      I: (NTFS)                                         931.5 GB (347.7 GB frei)
      Speicherkapazität                                 3017.4 GB (1336.8 GB frei)

    Eingabegeräte:
      Tastatur                                          HID-Tastatur
      Tastatur                                          HID-Tastatur
      Tastatur                                          HID-Tastatur
      Maus                                              HID-konforme Maus
      Maus                                              HID-konforme Maus
      Game Controller                                   Microsoft PC-joystick driver

    Netzwerk:
      Primäre IP-Adresse                                192.168.178.22
      Primäre MAC-Adresse                               BC-EE-7B-78-FA-E7
      Netzwerkkarte                                     Intel(R) Ethernet Connection I217-V  (192.168.178.22)

    Peripheriegeräte:
      Drucker                                           Fax
      Drucker                                           Microsoft Print to PDF
      Drucker                                           Microsoft XPS Document Writer
      Drucker                                           OneNote for Windows 10
      Drucker                                           PDF Architect 4
      Drucker                                           PDFCreator
      USB1 Controller                                   Intel(R) USB 3.0 eXtensible-Hostcontroller – 1.0 (Microsoft) [8086-8C31] [NoDB]
      USB-Geräte                                        G510 Gaming Keyboard
      USB-Geräte                                        Generic USB Hub
      USB-Geräte                                        Generic USB Hub
      USB-Geräte                                        Generischer Hochgeschwindigkeits-USB-Hub (SuperSpeed)
      USB-Geräte                                        Generischer USB-Hub
      USB-Geräte                                        HD-3000 - Microsoft LifeCam.
      USB-Geräte                                        Microsoft LifeCam HD-3000
      USB-Geräte                                        USB-Eingabegerät
      USB-Geräte                                        USB-Eingabegerät
      USB-Geräte                                        USB-Eingabegerät
      USB-Geräte                                        USB-Eingabegerät
      USB-Geräte                                        USB-Eingabegerät
      USB-Geräte                                        USB-Massenspeichergerät
      USB-Geräte                                        USB-Massenspeichergerät
      USB-Geräte                                        USB-Verbundgerät
      USB-Geräte                                        USB-Verbundgerät
      USB-Geräte                                        USB-Verbundgerät

    DMI:
      DMI BIOS Anbieter                                 American Megatrends Inc.
      DMI BIOS Version                                  1707
      DMI Systemhersteller                              ASUS
      DMI Systemprodukt                                 All Series
      DMI Systemversion                                 System Version
      DMI Systemseriennummer                            System Serial Number
      DMI System UUID                                   C07B966E-11D8DD11-B6B2BCEE-7B78FAE7
      DMI Motherboardhersteller                         ASUSTeK COMPUTER INC.
      DMI Motherboardprodukt                            VANGUARD B85
      DMI Motherboardversion                            Rev 1.xx
      DMI Motherboardseriennummer                       131118913300482
      DMI Gehäusehersteller                             Chassis Manufacture
      DMI Gehäuseversion                                Chassis Version
      DMI Gehäuseseriennummer                           Chassis Serial Number
      DMI Gehäusekennzeichnung                          Asset-1234567890
      DMI Gehäusetyp                                    Desktop Case




   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Ok and what is the data exactly consisting of (amount of subs etc)?


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

It's a 2 sessions, round about 100 lights per day (86 and 108) and 25 Darks, 35 Flats, 35 Darkflats, 50 BIAS each.

 

I cannot recreat the error. Don't know what happend.

But It's frustrating after 12 hours of calculations to end with nothing.

 

Is the a funktion were I can save my "APP sessions", like loaded files, progress in workflow, etc.?


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

I still have problems.

This night a 1. Session stack (198 Light, 105 Darks, 56 Flats, 64 Flatdarks and 73 BIAS) crashed the full PC.

No PC reaktions after all, so i cannot tell what was the problem.

Only thing i could see, it was during the integration progress at 16%.

Is the program a beta/alpha?

Anything I do wrong?

 

EDIT: It's a 24mm lens with APS-C chip (EOS 70DA) and Comet NEOWISE c/2020f3 in center.

This post was modified 4 years ago by Sven Hendricks

   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Sorry for the delay, it’s getting a bit busy here. So, you’re using the latest version as well? Have you already tried to process the sessions in chunks, like combining 1/4th of each and then combine? Just to see if it’s a memory issue somehow.


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

No problem, you're fast enought.

I think I have the latest version (I'm testing monthly trial, cause I don't know if i buy APP or Pixinsight.)

It looks like the preprocessing, stacking, streching is better at APP and that's the important part for me.

AND the MOSAIKING!!!!! is awesome!!!

 

I used the same parameters for a second tray (day time) and it processed it with no problems.

I don't know what's the problem.

It feels like the programm is stucked in a process or is infinety-looped.

I had an other process and i stoped it manual, cause it needed too much time to register the later frames.

The first 50 where done in minutes (each) and it got slower and slower to the stop by my self at frame 87.

The frame 87/123 needed 35 minutes, until I stoped it.

The process was in itteration 83 and the frame 86 took 45 itterations with 17 minutes.

 

Still realy good work, when it works. 😉

 

 


   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Yes the mosaic feature is really nice isn't it. 🙂 PI has more options, especially for post processing (it exists for far longer, APP will get there), but I think the mosaic feature already demonstrates a better basis regarding calibration and true optical distortion correction and such. Hope you like it enough. 🙂


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

I like good base programmed things, my informatic teacher told us so. 😉

I realy like it. In 15 days (rest trial time) and 1 week decision process and I'll know.

BUT I still like my workflow at darktable and photoshop for post processing, but what I need is:

- preprocessing

- stacking

- delightpolution and

- (photo metric) color calibration (for stars nd background)

in one programm

.

So PI isn't ahead cause of it's post processing.

I also like Fitswork, Regim, DDS, Fitsliberator, sequator and many more.

Every program for it's part, but I need an all-in-one version for astropics preprocessing.

The rest is fast done (atm), but a very good combination of all correction files and registration and combining is often hard work.

A good processing will take time, but when you know your tools, you just load and ajust it and let it run over night.

That's what I like here, I can do every process step single (if needed with hard conditions or complicat objects), but for the "every night" photos you know

the setting and go.

Hard are the overnight full crashs (just 2) but you do your programming (like I heard) and we'll see in future what happend.

If you realy do it on your own, maybe you get one or two other freaks (positiv) working together for this or that part, but it's your way to do.

Till here nice work, but a bit to go for the final.

I hope I'll get some swan hours, cause I want to do a mosaik full swan 24mm APS-C maybe some 900mm (to test the processing) at the smaler parts.

But the weather is against me, rain or just many/full clouds or around full moon, I like it NOT! 😉

 

But I think this problem here is done, if APP has a report or crash files I can send it or post if it helps.

 

Thanks till here Sven


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

Ok not done yet.

Next Error see attached files.

One

more Error message was shown, same als the first (when I'm 100% correkt).

Error messagees

 

EDIT: restarted the process, to see what's going on.

The error message apears every Masterframe (Dark, Flats...) but the process is still runing and not stopping, let's see.

Atm the flats are created, ....

Edit: Allway error stop during nutralization process.

Trying to save nurtalizied frames... I'll see when it works.

EDIT: It restarts calibartion process...

198 Lights, 42 Flats, 105 Darks, 54 DarkFlats, 67 BIAS source Canon EOS 70 Da 24mm; 3,2 sec; 1600 ISO.

APP settings: all on average and adaptiv rejection 6/3, multiply-scale, no blur, BPM enabled 3/10, cosmetic Correction  3/8/8, 32 bit Masters, seperat darks..., creat Masters, adaotive pedestal, calibration worning ... all enabled rest disabled.

 

EDIT: The different masters are now the problem, I get the option to choose which one but it always pops up a gain, I delet all data and retry.

 

 

This post was modified 4 years ago 4 times by Sven Hendricks

   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Mmm, weird one. What happens if you don't use the calibration files?


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

Ok Test Faild again!...ok, it's only not possible to open after processing...;-) tested with Fitswork it opens and after restarting APP it opens aswell.

I last checkt the screen (did a hand drawing during processing) at totaly last step combining pixels after LNC worked (so final picture).

15+ million pixel out of 22.54*.*** were allready done!

Here the full Informations I can get for you:

 

 Hope it helps.


   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Thank you,

So it’s a worker error, which usually has to do with multi-threading. I’ll tag Mabula for this one @mabula-admin

So to be clear, you tested without the calibration files and it failed right?


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

No, i used the correction files and I got it working instablely.

It procduced a endfile and many Error screens.

at the End (after saving the file), it crashed, by opening the produced file.

I always get it working, but often it take 2-4 rounds to get a file stacked.

The program often crashs or does conflict warnings.

 


   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

So can you try stacking without any correction files? Sometimes there is an issue in the calibration data that may cause that.


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

I tested it without any calibration frame and it worked without any errors.


   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Then the issue is your calibration data, you can try to add darks, integrate and see if that works and continue adding the data one by one, to see which calibration data is causing the issue.


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

..., it's only not possible to open after processing...

I got a file out of the full process.

But from time to time the program runs into infinity loops.

Different situations (Normalisation, registration, LNC,...) or crashes.

It's not only one stack, not only if I do this or that.

In my trial time I did 26 stacks (only 15 fame series, rest was new try with same data) and had 8 looping processes, 2 hard crashs and one freez.

It's not stable on my system, don't know why, but I never had this problems, not with any other stacking software.

I postet all Information, I can extract for you.

Hope it helps fixing some issus.

 

Trial is ending, CU soon, Sven


   
ReplyQuote
(@technohell)
Main Sequence Star
Joined: 4 years ago
Posts: 32
Topic starter  

Final comment:

It's a very nice programm nad a very goo stacking software, BUT only when it works.

I had a lot of trouble, I nerver had before (crashes freeses and so on).

So to buy a programm which is constantly crashing is no option for me.

Sorry, but i realy like the funktion when working, like mosaiking an LNC...

Let's see next year, maybe it'll get better.

 

Thanks for the support and your work.

Clear Skies Sven


   
ReplyQuote
(@vincent-mod)
Universe Admin
Joined: 7 years ago
Posts: 5707
 

Totally understandable and sorry for the inconvenience. I hope you check back in later versions.


   
ReplyQuote
Share: