chdkptp - alternative ptp client

mphx

@reyalp

To simplify things.

1.Both binaries (precompiled by you and compiled by me) are segfaulting.
2.dmesg segfault is from my compiled binary. ** but i just checked , dmesg message is the same for both binaries**

Your precompiled binary as far as i can understand uses one or two versions back of IUP and CD.
I used the latest available.Probably thats why one binary throws in some warning/errors and segfaults and the other one doesnt throws any messages and just segfaults.
So bottom line i believe that both binaries have the same problem and that must be something to do with libgobject-2.0.so.0.xxx which is part of the glib2 package. (installed version is 2.50.2-1).
I tried some older versions but it was no-go either.

I did some ldd with both binaries just to check if the various libgobject i was using were "used" by the binary.
https://www.dropbox.com/s/w590qzum8r6oy4f/ldd.zip?dl=0 ** i zipped 2 files containing the result of the ldd command for both binaries**
Probably they are the same libraries used and only difference would be the iup/cd libraries (especially in versions)

I dont have a debian/ubuntu distro handy at this time to check versions and stuff , if you have feel free to check it.If you need to check versions of specific packages/libraries/whatever feel free to tell me.

EDIT : Changing distros is not big deal but i'd like to stick with arch-based distro for mostly 2 reasons.Firstly there are precompiled packages i couldnt dream to find in any other distro.There is even chdkptp available ( https://aur.archlinux.org/packages/chdkptp) although it doesnt build correctly 😀 . So prebuilt/compiled packages is a big plus here.
Secondly , arch-based distros are bleeding edge and since i have a rather difficult hardware (hybrid graphics) i want to get new updates fast in hoping some things would get implemented or fixed some day.
Just for the history 😀

EDIT 2 :

IUP : iup-3.20-Lua52_Linux44_64_lib.tar.gz (+lua52 libs)
CD : cd-5.11-Lua52_Linux44_64_lib.tar.gz (+lua52 libs)

Thanks.

62ndidiot

I had some difficulties in ubuntu 15.04. I made a script for both the GUI version and line mode version to set things like ld_library_path etc.
I also after every reboot, manually have to:

sudo ldconfig /usr/lib64

reyalp

Here's ldd from the pre-compiled build running on Ubuntu 16.04. Nothing really jumps out at me comparing with yours.

The glib version on my system is 2.48.1

I did notice that yours has a bunch of wayland libraries. If gtk is trying to use wayland, using X instead might be something to try. The wiki page states

GTK+ 3 lets users select the desired GDK back-end by setting the GDK_BACKEND Unix environment variable.

I assume something like
export GDK_BACKEND=x11
before chdkptp is invoked

I wouldn't be at all surprised if IUP/CD have some X specific dependencies.

There's probably some error log for wayland (equivalent to .xsession-errors or /var/log/Xorg.N.log) which might provide more clues.

chdkptp-r723-ubuntu-16.04-ldd.txt

6.38KB

mphx

@reyalp

Lets take things in a order.

1.i pulled from old archives glib2 2.48.1 and linked chdkptp locally to it . no-go
2. According to this ( https://wiki.archlinux.org/index.php/wayland#GTK.2B_3 ) gtk3 backend defaults to X11 and can be overriden to use wayland backend with the command you suggested.Which it didn't make any difference.So that link might be telling the truth.
3.3 out of 4 wayland libs mentioned in my files , are mentionted to your file too.So i dont think wayland is involved / affecting anything here.
4.I didn't find any logs concerning wayland.Thats logic if you think that nothing related to wayland is running.Some packages pulled some wayland libs as dependencies apparently,nothing more.
/var/log/Xorg.N.log has zero errors (thats a shock!) , .xession-errors has nothing related to chdkptp.

I've noticed something odd that might be relevant or not.
As i said i have hybrid graphics.When i need to run something on my second gpu (the good one) i use something like "optirun <application>" and sends the <application> to the second gpu , using all the libs/drivers/etc that are related to this card.
Its the well-known bumblebee project , best solution for hybrid graphics so far in linux. 🙁

Well i was playing around with chdkptp and i issued "optirun ./chdkptp.sh" .It just displayed "starting gui..." and exited.Zero messages at dmesg.No "segmentation fault" at prompt. Like nothing ran at all.Pretty odd.

I presume that we are missing some strange version combination of libs involved in all this.

A good thing would be to zip your source folder with all libs involved in there , send it over to me , so i can try to compile it here , with your configuration , your combination of local libs.
Can't think of anything else to test/try at this moment...

reyalp

mphx
1.i pulled from old archives glib2 2.48.1 and linked chdkptp locally to it . no-go

Not surprising. It's quite likely that where the error occurs is not the source of the problem.

2. According to this ( https://wiki.archlinux.org/index.php/wayland#GTK.2B_3 ) gtk3 backend defaults to X11 and can be overriden to use wayland backend with the command you suggested.Which it didn't make any difference.So that link might be telling the truth.
3.3 out of 4 wayland libs mentioned in my files , are mentionted to your file too.So i dont think wayland is involved / affecting anything here.
4.I didn't find any logs concerning wayland.Thats logic if you think that nothing related to wayland is running.Some packages pulled some wayland libs as dependencies apparently,nothing more.

Yeah, that makes sense. I know very little about this wayland stuff.

/var/log/Xorg.N.log has zero errors (thats a shock!) , .xession-errors has nothing related to chdkptp.

To be clear, N is the display number (typically 0). If that's what you looked at, maybe error logging is turned off somewhere?

I've noticed something odd that might be relevant or not.
As i said i have hybrid graphics.When i need to run something on my second gpu (the good one) i use something like "optirun <application>" and sends the <application> to the second gpu , using all the libs/drivers/etc that are related to this card.
Its the well-known bumblebee project , best solution for hybrid graphics so far in linux. 🙁

Well i was playing around with chdkptp and i issued "optirun ./chdkptp.sh" .It just displayed "starting gui..." and exited.Zero messages at dmesg.No "segmentation fault" at prompt. Like nothing ran at all.Pretty odd.

I don't really know anything about this, but it wouldn't surprise me if optirun just didn't display the error.

A good thing would be to zip your source folder with all libs involved in there , send it over to me , so i can try to compile it here , with your configuration , your combination of local libs.

I don't understand how this would help. The libs I used are listed in README-LINUX-BINARIES.TXT

You could check out r723 of the chdkptp source if you wanted, but I'm very confident that none of the changes since then are relevant to this problem.

The config.mk I used is attached, but all it really does is set the paths.

Since both my build and yours crash in similar ways, my suspicion is that the errors are between IUP/CD and the GTK etc libraries on your system. But this is just a wild guess.

config.mk-deb64-r723.txt

1.88KB

mphx

@reyalp
After the last days , trying distros , running binaries , compiling sources.. the result is. ZERO 😀

After Manjaro/XFC4 , i installed ubuntu 16.10/Unity (clean install).First thing i did was to run chdkptp.Same segfault.
Updated it to 17.04.Thought newer versions there , maybe i will get lucky.Same story there.
I fcked up ubuntu installation at some point, so i ended up to Fedora since i want to run some 3d programs that are coming in rpm packages so suits me well.
Newest fedora runs wayland.First shock there 😀
export GDK_BACKEND=x11 did the trick though and after that , we are back to the same segfault.
I am starting to believe that iup/cd maybe want specific versions of specific system libraries 😀

Ah forgot to mention that every try was made , by compiling iup/cd(im)/lua52 every time to be sure that they are built against current system's libraries.
Its not big ,deal i can test stuff in chdkptp at studio (windows) but i'd like to have it available at home too...

srsa_4c

@mphx
You could try investigating those crashes a bit more. See posts starting here to get some ideas (gdb, backtrace).

reyalp

mphx
After Manjaro/XFC4 , i installed ubuntu 16.10/Unity (clean install).First thing i did was to run chdkptp.Same segfault.

That's strange, in the past builds on older versions of ubuntu have run fine on later versions for me.

Did you try my build on this OS?

Ah forgot to mention that every try was made , by compiling iup/cd(im)/lua52 every time to be sure that they are built against current system's libraries.

Do you really mean building IUP/CD ? I really don't recommend this (I remember we had a long conversation about this in the other thread). Up to now, I've had no problems using their pre-built libraries.

As srsa_4c suggests, debugging with gdb might give some clues.

mphx

@reyalp

Sorry,forgot to mention , that i firstly was testing pre-built binaries of yours , before starting compiling , in every distro i was installing.The result was the same with either binaries and compiled.

I did some debugging , dont know alot of it to dig really deep..but it was all ended up to glib2/libgobject library.
I will check the link too.

reyalp

mphx
Sorry,forgot to mention , that i firstly was testing pre-built binaries of yours , before starting compiling , in every distro i was installing.The result was the same with either binaries and compiled.

Thanks for clarifying.

I did some debugging , dont know alot of it to dig really deep..but it was all ended up to glib2/libgobject library.

If you can get stack trace, please post it.

If anyone else is using chdkptp on Linux, I'd be interested to know what distros the GUI is working (or not) on.

I'll try to investigate this further at some point, but unfortunately due to real life circumstance I have even less time for CHDK related stuff than usual.

mphx

@reyalp

Did some testing , not much though.Being on real physical machine or in a VM apparently doesn't affect anything.

1.Manjaro XFCE4 - NO
2.Ubuntu 16.10 Unity - NO
3.Ubuntu 17.04 Unity - NO
4.Opensuse Tumbleweed KDE (rolling branch of opensuse , quite bleeding edge) - NO
5.Fedora 25 Gnome - NO

Every case was producing the same segfault :

[ 6378.654711] chdkptp_gui[4240]: segfault at 544e4f46 ip 00007fb5fe871946 sp 00007ffe80dd0770 error 4 in libgobject-2.0.so.0.5000.0[7fb5fe83d000+52000]

Every time the same file , only different version.
Here is a backtrace (from gdb) of chdkptp_gui trying to run on a ubuntu 16.10 installation.

http://pastebin.com/GVbtLTu3 -Don't know if that will help at all..

62ndidiot

Doubt this is helpful but I've
attached ldd chdkptp for my ubuntu studio installation, which is working fine.
I believe I ended up not building iup, and just downloading their library.

lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 15.04
Release: 15.04
Codename: vivid

t.tmp

4.67KB

mphx

@62ndidiot

This installation is like 2 versions back.So we are talking about old version libraries.
Can you please check the version of glib2 package?This one provides libgobject library that is mentioned in segfaults.

@reyalp

Some of the essentials libraries are getting hard to be found in newer distros.
E.g. readline6 , libusb 0.1-4 .
So put in your TODO list at some point to compile iup/cd with newer libraries.They compile just fine as i found out lately.
Because even the latest versions of cd/iup , are not compiled with the latest readline and libusb libraries.

62ndidiot

Can you please check the version of glib2 package?This one provides libgobject library that is mentioned in segfaults.

pkg-config --modversion glib-2.0
2.44.1

locate libgobject
/usr/lib/i386-linux-gnu/libgobject-2.0.so.0
/usr/lib/i386-linux-gnu/libgobject-2.0.so.0.4400.1
/usr/lib/x86_64-linux-gnu/libgobject-2.0.a
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4400.1

I'm pretty sure I dynamically link to these when I run the gui version, because I need to issue ldconfig /usr/lib64, and locate libiup only returns stuff in /usr/lib64


 ls -l /usr/lib64
total 13424
-rwxr-xr-x 1 root root   71154 Mar 23  2016 libcdcairo.so
-rwxr-xr-x 1 root root   30022 Mar 23  2016 libcdcontextplus.so
-rwxr-xr-x 1 root root   35087 Mar 23  2016 libcdgl.so
-rwxr-xr-x 1 root root  202772 Mar 23  2016 libcdlua51.so
-rwxr-xr-x 1 root root  258670 Mar 23  2016 libcdlua52.a
-rwxr-xr-x 1 root root  202774 Mar 23  2016 libcdlua52.so
-rwxr-xr-x 1 root root    9284 Mar 23  2016 libcdluacairo51.so
-rwxr-xr-x 1 root root    9283 Mar 23  2016 libcdluacairo52.so
-rwxr-xr-x 1 root root    8485 Mar 23  2016 libcdluacontextplus51.so
-rwxr-xr-x 1 root root    2628 Mar 23  2016 libcdluacontextplus52.a
-rwxr-xr-x 1 root root    8484 Mar 23  2016 libcdluacontextplus52.so
-rwxr-xr-x 1 root root    8571 Mar 23  2016 libcdluagl51.so
-rwxr-xr-x 1 root root    2754 Mar 23  2016 libcdluagl52.a
-rwxr-xr-x 1 root root    8531 Mar 23  2016 libcdluagl52.so
-rwxr-xr-x 1 root root   18460 Mar 23  2016 libcdluaim51.so
-rwxr-xr-x 1 root root   17274 Mar 23  2016 libcdluaim52.a
-rwxr-xr-x 1 root root   18459 Mar 23  2016 libcdluaim52.so
-rwxr-xr-x 1 root root    8577 Mar 23  2016 libcdluapdf51.so
-rwxr-xr-x 1 root root    2764 Mar 23  2016 libcdluapdf52.a
-rwxr-xr-x 1 root root    8537 Mar 23  2016 libcdluapdf52.so
-rwxr-xr-x 1 root root   43387 Mar 23  2016 libcdpdf.so
-rwxr-xr-x 1 root root  799283 Mar 23  2016 libcd.so
-rwxr-xr-x 1 root root  752182 Mar 23  2016 libcdx11.so
-rwxr-xr-x 1 root root  710646 Mar 23  2016 libfreetype.so
-rwxr-xr-x 1 root root  217922 Mar 23  2016 libftgl.so
-rwxr-xr-x 1 root root    8617 Mar 23  2016 libiupcd.so
-rwxr-xr-x 1 root root  249421 Mar 23  2016 libiupcontrols.so
-rwxr-xr-x 1 root root   18926 Mar 23  2016 libiupgl.so
-rwxr-xr-x 1 root root  536609 Mar 23  2016 libiupimglib.so
-rwxr-xr-x 1 root root   18701 Mar 23  2016 libiupim.so
-rwxr-xr-x 1 root root  168042 Mar 23  2016 libiuplua51.so
-rwxr-xr-x 1 root root  172251 Mar 23  2016 libiuplua52.so
-rwxr-xr-x 1 root root    8578 Mar 23  2016 libiupluacd51.so
-rwxr-xr-x 1 root root    8539 Mar 23  2016 libiupluacd52.so
-rwxr-xr-x 1 root root   43660 Mar 23  2016 libiupluacontrols51.so
-rwxr-xr-x 1 root root   43663 Mar 23  2016 libiupluacontrols52.so
-rwxr-xr-x 1 root root   13903 Mar 23  2016 libiupluagl51.so
-rwxr-xr-x 1 root root   13905 Mar 23  2016 libiupluagl52.so
-rwxr-xr-x 1 root root   28467 Mar 23  2016 libiupluaglcontrols52.so
-rwxr-xr-x 1 root root   13183 Mar 23  2016 libiupluaim51.so
-rwxr-xr-x 1 root root   13183 Mar 23  2016 libiupluaim52.so
-rwxr-xr-x 1 root root    8279 Mar 23  2016 libiupluaimglib51.so
-rwxr-xr-x 1 root root    8279 Mar 23  2016 libiupluaimglib52.so
-rwxr-xr-x 1 root root   13725 Mar 23  2016 libiupluamatrixex51.so
-rwxr-xr-x 1 root root   13727 Mar 23  2016 libiupluamatrixex52.so
-rwxr-xr-x 1 root root   23822 Mar 23  2016 libiuplua_mglplot51.so
-rwxr-xr-x 1 root root   23824 Mar 23  2016 libiuplua_mglplot52.so
-rwxr-xr-x 1 root root   33970 Mar 23  2016 libiuplua_plot52.so
-rwxr-xr-x 1 root root   23695 Mar 23  2016 libiuplua_pplot51.so
-rwxr-xr-x 1 root root   23699 Mar 23  2016 libiuplua_pplot52.so
-rwxr-xr-x 1 root root   13396 Mar 23  2016 libiuplua_scintilla51.so
-rwxr-xr-x 1 root root   13398 Mar 23  2016 libiuplua_scintilla52.so
-rwxr-xr-x 1 root root   12846 Mar 23  2016 libiupluatuio51.so
-rwxr-xr-x 1 root root   12848 Mar 23  2016 libiupluatuio52.so
-rwxr-xr-x 1 root root   13181 Mar 23  2016 libiupluaweb51.so
-rwxr-xr-x 1 root root   13183 Mar 23  2016 libiupluaweb52.so
-rwxr-xr-x 1 root root  127694 Mar 23  2016 libiupmatrixex.so
-rwxr-xr-x 1 root root 2233105 Mar 23  2016 libiup_mglplot.so
-rwxr-xr-x 1 root root  714563 Mar 23  2016 libiupmot.so
-rwxr-xr-x 1 root root  249138 Mar 23  2016 libiup_pplot.so
-rwxr-xr-x 1 root root 2756612 Mar 23  2016 libiup_scintilla.so
-rwxr-xr-x 1 root root  773930 Mar 23  2016 libiup.so
-rwxr-xr-x 1 root root  168829 Mar 23  2016 libiuptuio.so
-rwxr-xr-x 1 root root   20644 Mar 23  2016 libiupweb.so
-rwxr-xr-x 1 root root 1461133 Mar 23  2016 libpdflib.so
drwxr-xr-x 2 root root    4096 Jul 30  2015 sane

Some of the essentials libraries are getting hard to be found in newer distros.
E.g. readline6 , libusb 0.1-4 .
So put in your TODO list at some point to compile iup/cd with newer libraries.They compile just fine as i found out lately.
Because even the latest versions of cd/iup , are not compiled with the latest readline and libusb libraries.

Advice for me? 🙁 I've almost bit the bullet and done an upgrade a couple of times this year. Both times I talked myself out of it, mainly because it might disrupt my CHDK efforts and gain me little or nothing in the way of functionality.

When I do upgrade, I will leave my current distro intact and bootable just in case.

reyalp

mphx
http://pastebin.com/GVbtLTu3 -Don't know if that will help at all..

Not really obvious. AFAIK iupMap is what creates/displays the actual windows and controls. So maybe there is some specific control that is doing something weird that was ignored in older version but is now a problem.

One way to debug this would be to disable everything except the basic window, and if that works, start re-enabling stuff until it crashes again. That would take some understanding of the code to do effectively though.

reyalp

62ndidiot
I'm pretty sure I dynamically link to these when I run the gui version, because I need to issue ldconfig /usr/lib64, and locate libiup only returns stuff in /usr/lib64

Assuming you start using the .sh file, the current pre-built packages should be self contained and not require you to install anything in the system /lib directories.

edit:
Of course, you should be able to use a similar script with your own builds as long as you point LD_LIBRARY_PATH at wherever you put the libs

reyalp

mphx
Some of the essentials libraries are getting hard to be found in newer distros.
E.g. readline6 , libusb 0.1-4 .
So put in your TODO list at some point to compile iup/cd with newer libraries.They compile just fine as i found out lately.
Because even the latest versions of cd/iup , are not compiled with the latest readline and libusb libraries.

I don't understand. chdkptp is linked to libusb and readline, but that should have nothing to do with CD and IUP.

mphx

@reyalp

Ye my bad with readline.I saw it a lot during compiles and thought its iup/cd dependency.Now i am reading that its lua dependency , thats explains the whole connection to it.
Bottom line is that these versions are getting old and some -not all- , some distros just keep them for compatibility purposes only.

reyalp

mphx
Ye my bad with readline.I saw it a lot during compiles and thought its iup/cd dependency.Now i am reading that its lua dependency , thats explains the whole connection to it.

chdkptp uses readline to provide command history in CLI mode. This is a compile time option you can turn off by setting READLINE_SUPPORT=0 in config.mk. I'm not aware that it specifically requires readline 6 rather than 7, but I haven't looked into it.

The Lua standalone interpreter can also use readline, but this shouldn't be relevant to chdkptp

libusb-0.1 is the USB API chdkptp uses to communicate with the camera. It's a legacy API, but changing to a different one would require a significant amount of work. AFAIK on linux versions it's just a compatibility wrapper over more recent APIs anyway. On windows, libusb-win32 only supports the 0.1 API, so a different library would need to be used.

There are good reasons to update the USB API, but it's not likely to be a simple project.

Bottom line is that these versions are getting old and some -not all- , some distros just keep them for compatibility purposes only.

As long as they are available and compatible, I don't see much reason to change. I'd much rather figure out why it's crashing.

edit:
OK, set up an ubuntu 16.10 VM. I understand the point about readline/libusb is that users will get load errors if the corresponding packages aren't installed. This is what you get trying to run pre-compiled binaries in linux.

I also get the segfault you described on on startup using the prebuilt build.

reyalp

I tracked the segfault down to the mode dropdown.

Running the IUP example http://webserver2.tecgraf.puc-rio.br/iup/examples/Lua/list.lua also segfaults, unless I comment out the dropdown, so I'm guessing this is an IUP bug (though I suppose it could be triggered by some aspect of how chdkptp is built, I haven't tried running it in a non-chdkptp executable).

You can make chdkptp work by commenting out the line that adds the dropdown in gui.lua, like

	iup.hbox{
--		gui.mode_dropdown,
	},

Obviously, you will no longer be able to set the shooting mode with this control.

edit:
I confirmed the crash happens running their examples + precompiled binaries.

« Previous Page Next Page »