Share:

APP 1.075 has been released !

2019 September: Astro Pixel Processor and iTelescope.net celebrate a new Partnership!

[Sticky] Which image formats are supported by APP?  

Page 1 / 2
  RSS

(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
June 1, 2017 13:33  

APP currently supports the following image formats:

  • FITS, read and write, 8,16,32 bits integers, 32bits floats, 64bits doubles. (see FITS Note)
  • Canon CR2, read, list of tested camera models here (but see CR2 Note at the bottom).
  • Nikon NEF, read, list of tested camera models here
  • Sony ARW, read, list of tested camera models here will be fully supported from APP version 1.072 ! to be released around the 1st of March 2019
  • Adobe DNG, read, fully supported from APP 1.075 (release date in October 2019)
  • Other RAW file formats of the other brands like Pentax, Fuji, Olympus, Panasonic, will be supported in the versions following APP 1.075
  • TIFF, read and write, 8,16,32 bits
  • JPG, read and write, 8,16 bits

APP has it's own raw conversion code for both Canon CR2 and Nikon NEF frames. The conversion of CR2 and NEF files is completely written by Mabula himself. The implementation of other RAW image formats (Adobe DNG, Sony, Fuji, Pentax for instance) is on the TODO list to be implemented with high priority and these formats will be supported through LibRaw. If you do encounter problems with your current CR2, NEF or FITS files or want to request other image formats, please share this on this forum.

 FITS Note: APP uses the NASA FITS library nom.tam.fits, which follows the known FITS conventions. APP can read uncompressed and compressed FITS files and writes uncompressed FITS files. Writing compressed FITS files will be supported in the near future.

CR2 Note: there is no support currently for sRaw, sRaw2 formats, the sRaw and sRaw2 formats aren't supported yet in APP, because these formats don't contain linear data and are of lower resolution. The data is stored using YCbCr 4:2:2 chroma subsampling encoding. Before encoding the data, the data is transformed by your camera to one of the available non-linear colorspaces (e.g. sRGB, Adobe 1998). Linear data is essential for astronomical data calibration and processing, like data normalization and integration. If you are shooting data with your Canon DSLR, always set the data format at RAW, not at sRaw or sRaw2.

Adobe DNG Note: please use the latest version of Adobe DNG converter to convert your frames of yet unsupported camera brands to the DNG format so you can process them in Astro Pixel Processor, starting from version APP 1.075. Download Adobe DNG Converter here:  https://helpx.adobe.com/photoshop/digital-negative.html

This topic was modified 9 months ago 2 times by Mabula Haverkamp - Admin
This topic was modified 1 month ago 4 times by Mabula Haverkamp - Admin

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
(@pwsasus)
Hydrogen Atom Customer
Joined: 2 years ago
Posts: 2
September 9, 2017 22:01  

Hi Mabula,

unfortunately APP doesn't support Fuji RAF raws. Also APP doesn't support the DNG format. So I have no meaningful possibility to work with my Fuji images in APP. 

I don't want to convert my raws to tiff (file size etc).

It's a pity because I think that APP would be a very good piece of software for me.

 

br

Paul


ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
September 10, 2017 12:01  

Hi Paul,

Thank you for bringing this to my attention.

Support for Fuji RAF raws and DNG are on my priorities list. You can keep track of this here:

https://www.astropixelprocessor.com/community/development-priorities/current-priorities/

And release info can be seen here:

https://www.astropixelprocessor.com/community/release-information/

Currently I still have some more pressing priorities (like a complete Quick Reference Guide) but soon the support for other file formats will be the highest priority.

Kind regards,

Mabula

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
(@pwsasus)
Hydrogen Atom Customer
Joined: 2 years ago
Posts: 2
September 10, 2017 22:08  

Hi Mabula,

I've no luck :-). Have tried to load a set of data made with my Canon 5D Mk iv. No success. Yes, have seen that the Canon 5D Mk iv isn't supported at the moment.

br
Paul


ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
September 11, 2017 20:12  

Hi Paul,

That's unfortunate, I will add the Canon EOS 5D Mark IV, I have put it on my todo list.

I'll try to have it supported in the next release. 

Off course, your trial can be restarted once it's working 😉 (Just contact me then using support@astropixelprocessor.com)

Kind regards, 

Mabula

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
 akaw
(@akaw)
Molecular Cloud Customer
Joined: 2 years ago
Posts: 3
October 26, 2017 13:18  

Hi Mabula,

Would it be possible, in the near future, for support of the old Canon EOS 300D's CRW file? CR2 file from my Canon EOS 350D loads fine and AAP gives me impressive results. I have many images taken twelve years ago with the 300D and it's sad that AAP cannot open them.

Best regards,


ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
October 27, 2017 00:30  

Hi Akaw,

I will have a look at the EOS300D CRW files, I do have such a file in my library so I can test.

I'll let you know if it's possibly on a short term.

Kind regards,

Mabula

 

 

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
 akaw
(@akaw)
Molecular Cloud Customer
Joined: 2 years ago
Posts: 3
October 27, 2017 01:50  

Thank you so much and sorry for the typo, with AAP I mean APP.

Best regards,

Wiwat


ReplyQuote
(@benolry)
Brown Dwarf Customer
Joined: 2 years ago
Posts: 8
February 19, 2018 11:15  

+1 for DNG Support. I think you could help most customer with DNG support as this is a format that almost all raw files can be converted to without big issues(even manufacturer/model specific color matrix is saved). May I ask why you wanted to avoid a dcraw dependency? Does it lack features or does it collide with your release strategy to have such strong ties to other projects? Best regards,

Ben


ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
March 4, 2018 18:08  

Hi @benolry,

Yes, DNG support is important to implement soon, I fully agree. Using Adobe DNG conversion, the camera support of APP will increase greatly 😉

Yes, having the model specific camera matrix is important so that's nice.

DCRAW dependency: simply said, I want to have full control and understand these Raw formats myself. APP can calibrate your DSLR data dynamically, internally in the image loader. A feauture which wouldn't be possible with a DCRAW dependency to load these RAW frames. Furthermore, I know the DCRAW code and it's creator certainly has done a great job, I also know it's taking a shortcut here and there (tremendous bit fidling) and not everything is done properly, at least that's my own opinion. 

Perhaps the most important reason is that I don't want to depend on others to be able to support new camera models, if I know how these files work, I can faster implement new camera models 😉 (almost immediately to be honest, I would need just 1 RAW for testing). The reason that APP doesn't support all DSLR brands yet, is mainly due to my choice of first making an actual complete Deep Sky integration and processing application before working on full camera support. Work on extending camera support will soon start now though 😉 

Cheers,

Mabula

 

 

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
(@imnewhere)
White Dwarf Customer
Joined: 2 years ago
Posts: 22
March 13, 2018 00:57  

If you need sample files in both .dng and .pef from a Pentax K1, Pentax K3, Pentax K-01, and Pentax 645z I will gladly supply those. I may even be able to dig up a .dng from a Pentax K5.


ReplyQuote
(@imnewhere)
White Dwarf Customer
Joined: 2 years ago
Posts: 22
March 21, 2018 23:07  

Actually, here's a link to a shared Google drive with a Pentax 645z .dng file, a Pentax K1 .dng file, a Pentax K3 .dng file, a Pentax K5 .dng file, and a Pentax K-01 .dng file.

https://drive.google.com/open?id=1wGmqQc3-bFnYJ1sn0vEEJcHj4nX0lmcp


ReplyQuote
(@benolry)
Brown Dwarf Customer
Joined: 2 years ago
Posts: 8
October 8, 2018 11:34  

Here is a sample of a Sony A7R mark 2 that is converted from Sony's own raw format to DNG without compression or embedded raw/thumbnail:

 

https://drive.google.com/open?id=1Bqehukqlp7awqJtkBeVyYmx6xQ8k8b9Q

 

Best regards and clear skies,

 

Ben


ReplyQuote
 Hans
(@hans)
Hydrogen Atom Customer
Joined: 2 years ago
Posts: 1
October 21, 2018 22:18  

I would really like to see XISF support being added to APP.
The format is described and documented here <a href=" removed link " target="true"> removed link including reference C++ code.

-- Hans

 

This post was modified 1 year ago 2 times by Mabula Haverkamp - Admin

ReplyQuote
(@vincent-mod)
Galaxy Moderator
Joined: 2 years ago
Posts: 928
October 21, 2018 22:52  

Ah yes, Mabula knows all about it, but prefers the fits format as it's a clear standard in the field and amongst scientists. Given the time it takes to develop it won't be a priority at the moment, if ever unfortunately.


ReplyQuote
(@philippe-deschenesgmail-com)
Hydrogen Atom Customer
Joined: 1 year ago
Posts: 1
October 23, 2018 02:01  

+1 on Panasonic RW2 and/or DNG support.  For some reason I have not been able to find a good converter to get TIFF from RW2.  It works OK for lights, but is not adequate for Bias or Darks.  So only able to stack the light frames...  RW2 to DNG converts with no problems.

Thanks, I understand we are all asking for specific needs, so I appreciate you are considering those and putting them in your backlog 🙂

Philippe


(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
October 24, 2018 22:29  
Posted by: benolry

Here is a sample of a Sony A7R mark 2 that is converted from Sony's own raw format to DNG without compression or embedded raw/thumbnail:

 

https://drive.google.com/open?id=1Bqehukqlp7awqJtkBeVyYmx6xQ8k8b9Q

 

Best regards and clear skies,

 

Ben

Hi Ben @benolry.

Thank you, I have saved the file with my other DNG files that I have for testing. I will soon implement DNG support as the first step to open APP up for most Raw File formats using the Adobe DNG converter.

Mabula

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
October 24, 2018 22:51  

Posted by: Hans

I would really like to see XISF support being added to APP.
The format is described and documented here <a href=" removed link " target="true"> removed link including reference C++ code.

-- Hans

Posted by: vincent-mod

Ah yes, Mabula knows all about it, but prefers the fits format as it's a clear standard in the field and amongst scientists. Given the time it takes to develop it won't be a priority at the moment, if ever unfortunately.

Hi Hans @hans and Vincent @vincent-mod,

Never say never 😉

but... Vincent is right, XISF support is very low on my ToDo list with respect to development priorities for several reasons:

first of all, XISF is actually only used by Pixinsight who created it. FITS can contain any data that XISF can. A Pixinsight user can simply convert it's XISF data to FITS without loss of data.
No camera maker or capture software supports XISF (as far as I know, let me know otherwise 😉 ) and most state clearly that FITS is the defacto standard in astronomy and that they will not change that. If camera makers were to use XISF over FITS, then the priority to implement XISF support would be of vital importance off course.
I have not seen any technical argument why XISF should be preferred over FITS for storage of astronomical data. FITS can store anything you want if you study the specification... including lossless data, graphs, multiple images etc... The astronomical community worldwide has been using FITS for decades now, the specification has grown significantly and it is actively maintained and used by NASA. Off course, if anyone knows of a feature of XISF that FITS can't deal with, let me know 😉 I like to be surprised.
Last but not least, my current development list is very long with features to implement that APP is currently still lacking and which are needed in a lot cases to make APP a complete solution to process Deep Sky images.

So in due time, XISF support can be implemented, but as it is right now, I see no critical need to implement this before other critical features since XISF data can always simply be converted to FITS.

Kind regards,

Mabula

 

Main developer of Astro Pixel Processor and owner of Aries Productions


ReplyQuote
(@mabula-admin)
Quasar Admin
Joined: 3 years ago
Posts: 2160
October 24, 2018 22:53  
Posted by: philippe.deschenes@gmail.com

+1 on Panasonic RW2 and/or DNG support.  For some reason I have not been able to find a good converter to get TIFF from RW2.  It works OK for lights, but is not adequate for Bias or Darks.  So only able to stack the light frames...  RW2 to DNG converts with no problems.

Thanks, I understand we are all asking for specific needs, so I appreciate you are considering those and putting them in your backlog 🙂

Philippe

Hi Philippe @philippe-deschenesgmail-com,

Thank you, yes I am making the implementation of Adobe DNG support a high priority now 😉 so I hope to have this as part of APP soon now.

Kind regards,

Mabula

Main developer of Astro Pixel Processor and owner of Aries Productions


ImNewHere liked
ReplyQuote
(@imnewhere)
White Dwarf Customer
Joined: 2 years ago
Posts: 22
November 18, 2018 20:49  

I sent some more Canon and Nikon people your way. I am looking forward to when .dng is supported.

Also, I can definitely supply you with lights, darks, flats, and bias for the Pentax K1, K3, K5, and K-01. I'm thinking of adding a Kp, and I am getting my K1 updated to a K1ii, and if all goes will I will get my own 645z, though I still have some files left from where I borrowed it from a friend.

This post was modified 12 months ago by ImNewHere

ReplyQuote
Page 1 / 2
Share: