supplierdeeply

sx710 porting thread

  • 25 Replies
  • 10182 Views
Re: sx710 porting thread
« Reply #10 on: 06 / June / 2018, 15:23:56 »
Advertisements
Can't get it to boot from the card (16gb, FAT32) and I'm guessing it's because I don't have a FI2 file. Don't see one in the zip, so I'm assuming there's somewhere else to get it?
What boot method are you trying to use?  The fi2 file is only needed for the "firmware update" method - which is not currently supported on most recent cameras.  Hence the missing file.

Perhaps the more important question is how did you setup your SD card ?  Did your goggle fu take you here?

http://chdk.wikia.com/wiki/Prepare_your_SD_card

The utilities listed at the top of that page are very recommended.
« Last Edit: 06 / June / 2018, 15:36:03 by waterwingz »
Ported :   A1200    SD940   G10    Powershot N    G16

Re: sx710 porting thread
« Reply #11 on: 28 / July / 2018, 10:14:12 »
Thanks a lot for porting to the SX710HS!

Does any body have lens correction parameters for the CHDK's DNG? Has somebody managed to reverse the built-in parameters from the original Canon firmware (maybe even for a different model?

*

Offline reyalp

  • ******
  • 11592
Re: sx710 porting thread
« Reply #12 on: 28 / July / 2018, 15:50:09 »
Does any body have lens correction parameters for the CHDK's DNG?
I don't. I use presets in I made in raw therapee with the distortion and CA settings set by eyeball for a few different zoom levels.

Quote
Has somebody managed to reverse the built-in parameters from the original Canon firmware (maybe even for a different model?
Nope. Would be a great contribution if someone figured out how to do it. Some related discussion in https://chdk.setepontos.com/index.php?topic=13461.0

I think SX700 is the only model that shares the same lens, but I could be wrong.
Don't forget what the H stands for.

*

Offline blackhole

  • *****
  • 642
  • A590IS 101b
    • Planetary astrophotography
Re: sx710 porting thread
« Reply #13 on: 29 / July / 2018, 07:44:31 »
Thanks a lot for porting to the SX710HS!

Does any body have lens correction parameters for the CHDK's DNG? Has somebody managed to reverse the built-in parameters from the original Canon firmware (maybe even for a different model?
Look here:
https://chdk.setepontos.com/index.php?topic=9268.msg130395#msg130395

If you think this is too complicated, I can create a lens profile for you if you send me calibration images.
This means optimally 27 dng files, 9 images per one focal length.
The minimum acceptable would be 15 dng files, 5 images per focal length (4 corners and the middle).


Re: sx710 porting thread
« Reply #14 on: 09 / August / 2018, 09:44:58 »
I loaded the CHDK on my SX710 HS and I went through some of the settings. Here is what I found:

1. Dark frame subtraction was not working in neither modes.
2. Video time or bitrate display was not working. Frozen at 00000
2.1 There are no video or jpeg options related to quality.
3. Show raw saving time did not display the time.
4. Overall the OSD was blinking from time to time when the camera was moving

This is my take. Amazing job. I wished the dark frame sub was working but It seems it is not for now. Oh, my version is 1.01A and I used the SD method with the automatic java program.
« Last Edit: 09 / August / 2018, 11:40:01 by tarnovo83 »

*

Offline reyalp

  • ******
  • 11592
Re: sx710 porting thread
« Reply #15 on: 09 / August / 2018, 13:55:08 »
Thanks for reporting.
1. Dark frame subtraction was not working in neither modes.
What Canon shooting mode were you using? I have this listed as working in my notes, so it probably worked for me at least once, but it may depend on Canon settings, or whether you waited for the camera to be ready in half press.
Quote
2. Video time or bitrate display was not working. Frozen at 00000
No video related features are implemented.
Quote
2.1 There are no video or jpeg options related to quality.
The camera firmware already lets you set superfine jpeg quality, so there's no need for a CHDK jpeg option.

Quote
3. Show raw saving time did not display the time.
You can see this by going to misc->console->display last console

Quote
4. Overall the OSD was blinking from time to time when the camera was moving
This is a known issue, see https://chdk.setepontos.com/index.php?topic=12758.msg132871#msg132871
Don't forget what the H stands for.

Re: sx710 porting thread
« Reply #16 on: 13 / August / 2018, 08:31:58 »
I take my words back. When I activated and tried 60 second exposure the dark frame (always on) kicked in. It works great.

p.s. The camera record raw DNG file but most bad_pixel tools want a CR2 file. The internal algorithm of CHDK does not find any bad-hot pixels, but I see many of them. Any ideas how to create the bad pixel list?

*

Offline reyalp

  • ******
  • 11592
Re: sx710 porting thread
« Reply #17 on: 13 / August / 2018, 13:52:20 »
I take my words back. When I activated and tried 60 second exposure the dark frame (always on) kicked in. It works great.
Thanks for the update. It's possible there's some combination of settings where it doesn't work, so if you find it failing again, please let me know.
Quote
p.s. The camera record raw DNG file but most bad_pixel tools want a CR2 file.
You can turn off DNG by unchecking DNG format. Raw will then be saved as a frame buffer dump (with a CR2 extension) but note that this is NOT the same as the real Canon CR2 format. The old badpixel tools may need to be re-compiled to with the correct dimensions.
Quote
The internal algorithm of CHDK does not find any bad-hot pixels, but I see many of them.
The DNG badpixel process only generates a list of pixels that are set to 0 by the Canon firmware, as an optimization. It doesn't handle hot pixels.
Quote
Any ideas how to create the bad pixel list?
You can create a hot pixel list using chdkptp, see here https://app.assembla.com/spaces/chdkptp/wiki/DNG_Processing

If you are doing long exposures, you might consider using dark frames instead. You can create dark frames using this script: http://chdk.wikia.com/wiki/Lua/Scripts:_Fixed_Exposure_Intervalometer
Don't forget what the H stands for.


Re: sx710 porting thread
« Reply #18 on: 17 / August / 2018, 11:48:35 »
Hi there again. I have been reading some of your discussion on other topics here in the forum and I also tried the script you mentioned. Here is my take:

1. I thought the script would make the dark-master frame iteself and USE IT internally without having to take double exposures each time. But from other read and the manual of the script you suggest that I should use the RAWTherapee dark-frame option in post-process.

2. Would it be possible to have CHKD or the script itself, to have the option to subtract the MASTER DARK FRAME on the camera. No extra exposures, maybe just 1 time to make it or if you point to a file to use.

3. I cannot find the "RAW COMBINE" function mentioned in the scrip manual. Is it supposed to be somewhere in the menu of CHKD?

4. I actually really want to use the Fiji or AstroImageJ programs but I cannot get them to work properly with the DNG files. I read a bunch of your replies in other threads and I tried everything but it simply does not. I tried an import plug-in you suggested and it does import the files but it does no show them in raw formats anymore and the mathematical operations get messed up. I wanted to use Fiji for my dark corrections and other functions but I am forced to convert to TIF.

5. RawTherapee is extremely slow on my very decent laptop and it crashes also. It represents the raw files very weirdly with messed up colors and values. I tried the dark-sub function and I cannot seem to get easy results. Lightroom and Photoshop import the files very nicely, but the functionality is not there.

6. I did a comparison between the Canon native dark-frame double exposure method and a simple dark-frame subtraction.

64 seconds, ISO 800 Canon SX710 HS
Frame 1: The noise from my camera (no canon native dark-frame management)
Frame 2: Two noisy frame subtracted from each other
Frame 3: This is what Canon does to a dark image with its dark-frame management
Frame 4: The canon management + additional background subtracted with ImageJ


*

Offline reyalp

  • ******
  • 11592
Re: sx710 porting thread
« Reply #19 on: 17 / August / 2018, 17:37:16 »
1. I thought the script would make the dark-master frame iteself and USE IT internally without having to take double exposures each time. But from other read and the manual of the script you suggest that I should use the RAWTherapee dark-frame option in post-process.
Correct, the dark frame option in the script is only there to allow you to take images with the shutter closed. You should be able to use them in any workflow that supports dark frames, though you may have to convert the format.

If your workflow supports it, making the master dark using median should give better results than the in camera average.

Quote
2. Would it be possible to have CHKD or the script itself, to have the option to subtract the MASTER DARK FRAME on the camera.
Raw subtract can technically be done from script, but it would be very slow (you can try the subtract option in the file browser to see), which would defeat the purpose of disabling Canon dark frames in most cases. If you're going to the trouble to make separate dark frames, you're better off doing the processing on your PC.

Quote
3. I cannot find the "RAW COMBINE" function mentioned in the scrip manual. Is it supposed to be somewhere in the menu of CHKD?
Raw operations are available in the CHDK menu from the file browser: https://chdk.wikia.com/wiki/CHDK_User_Manual#File_Browser

Quote
4. I actually really want to use the Fiji or AstroImageJ programs but I cannot get them to work properly with the DNG files.
Unless there's some problem specifically with CHDK DNG files, that's between you and those programs. You might have better results converting DNG to another format first.

If the programs specifically have trouble with CHDK DNGs, it might be caused by the packed 12 bit format, which is valid but somewhat less well supported than 16 bit. In that case, you could run them through adobe DNG converter.

If the problem is DNG support in general, rather than the fact that they are bayer raw, there are some programs you can use convert to a simple 16 bit format without debayering, for example dcraw, chdkptp, or rawconvert from the chdk source.

Quote
5. RawTherapee is extremely slow on my very decent laptop and it crashes also.
If you are using windows, the performance may be improved a lot by closing all the different control areas you aren't using. E.g. a top level group like "exposure" has a triangle next to it, which points down when all the options are open, and to the right with they are closed. Close all the ones you aren't using. There's some weird GTK/windows issues that makes it super slow if the options are expanded. This is true even for tabs which aren't currently visible.

On my system (old sandy bridge i5), this makes the difference between unusable and slightly sluggish.

Quote
It represents the raw files very weirdly with messed up colors and values.
By default, raw therepee does a contrast stretch, which is very ugly when a large portion of the image is near black level. Clicking the "reset" in the exposure tab (or "neutral" for older versions) will give you a much more normal rendering. If you make a workflow based on raw therapee, you will want to create presets that you can load as a starting point. If you shoot a bunch of images for a stack or something, you create one profile for batch and "paste" it onto all the other files. It also supports running batches form the command line, though I haven't actually used that.

FWIW, I don't specifically recommend raw therepee as the best tool for the job, I mention it because it's a program I've found good enough for my personal needs.
Don't forget what the H stands for.

 

Related Topics