Module code V2 - test branch. - General Discussion and Assistance - CHDK Forum
« previous next »
Pages: [1] 2 3   Go Down

Module code V2 - test branch.

  • 29 Replies
  • 14131 Views
*

Offline philmoz

  • *****
  • 3450
    • Photos
Module code V2 - test branch.
« on: 10 / March / 2013, 04:45:53 »
Advertisements
I've created a test branch (philmoz-modulesV2) for review/testing of some rework I've done on the module system.

The core changes are:

1. Auto-load of modules when the module functions are used.
This replaces code like:
            if (libscriptapi)
                libscriptapi->set_as_ret(0);
with just
            libscriptapi->set_as_ret(0);

2. Cleaned up unloading and management of module lifetime.
Each loop of the keyboard task the code now asks each module if it can be unloaded. If it returns true then the module is removed.
This leaves knowledge and management of the module to the module itself rather than in the core CHDK code. The dng, grid, zebra and edge overlay modules can now unload when not being used instead of remaining in memory.
The code also alerts modules when CHDK is leaving <ALT> mode. Many of the modules are only valid in ALT mode (games etc) so they need to quit and unload if the user presses the ALT button.

3. Added logging of the load/unload of the modules to a text file.
This can be enabled in the Miscellaneous stuff --> Modules menu. There is also a menu option to delete the log file. The log file is always appended to so it can grow out of control if logging is left on. The log also includes a timestamp when the system writes the first entry each time the camera is restarted.

4. Updated Lua to version 5.1.5 (Feb 2012 release) from 5.1.3 (Jan 2008 release).
I also looked at 5.2; but the changes are much more substantial so will take a lot more effort to update.

Phil.
Logged
CHDK ports:
  sx30is (1.00c, 1.00h, 1.00l, 1.00n & 1.00p)
  g12 (1.00c, 1.00e, 1.00f & 1.00g)
  sx130is (1.01d & 1.01f)
  ixus310hs (1.00a & 1.01a)
  sx40hs (1.00d, 1.00g & 1.00i)
  g1x (1.00e, 1.00f & 1.00g)
  g5x (1.00c, 1.01a, 1.01b)
  g7x2 (1.01a, 1.01b, 1.10b)
*

Offline waterwingz

  • ******
  • 12139
    • Waterwingz
Re: Module code V2 - test branch.
« Reply #1 on: 10 / March / 2013, 08:45:41 »
I assume you'd like some testing on a few different cameras?  Any thoughts on a test suite - sounds like multiple loading & unloading of anything that's done in modules is on order here?  Is it worth running a few Lua programs for test purposes? Doesn't look like you have any VxWorks cams on your personal list but so I assume it would be good to find someone who can test a few of those as I don't either......
Logged
Ported :   A1200    SD940   G10    Powershot N    G16
*

Offline reyalp

  • ******
  • 14082
Re: Module code V2 - test branch.
« Reply #2 on: 10 / March / 2013, 16:01:10 »
Nice work phil. I haven't looked at this, but it sounds good to me.
Quote from: philmoz on 10 / March / 2013, 04:45:53
4. Updated Lua to version 5.1.5 (Feb 2012 release) from 5.1.3 (Jan 2008 release).
I also looked at 5.2; but the changes are much more substantial so will take a lot more effort to update.
FWIW, 5.2 includes several features that would be quite useful for CHDK.
- ability to yield across certain C calls (meaning dofile, require, pcall could behave more nicely with blocking CHDK API calls)
- emergency garbage collector. Tries to collect garbage if allocation fails. By itself this probably wouldn't help too much since the OS would probably fall over when you got that low on memory, but with a custom allocator aware of the actual amount of memory available it could be quite useful.
- native bitwise operation library. We already have bit* functions, the main benefit that would be that it would be more portable to other lua code and documented with the core language.

I am NOT saying you should to go out and do this, just that there are worthwhile things there if someone wants to do it.

Also note that Lua doesn't strictly maintain language and library compatibility between releases, so it's possible some existing scripts would be incompatible. They usually provide build time options for deprecated features for one release.
Quote
There is also a menu option to delete the log file. The log file is always appended to so it can grow out of control if logging is left on. The log also includes a timestamp when the system writes the first entry each time the camera is restarted.
I was going to suggest an option for clearing this at boot, but that would be bad for crash debugging. An option might be to rotate it at boot?
Logged
Don't forget what the H stands for.
*

Offline philmoz

  • *****
  • 3450
    • Photos
Re: Module code V2 - test branch.
« Reply #3 on: 11 / March / 2013, 04:53:13 »
Quote from: waterwingz on 10 / March / 2013, 08:45:41
I assume you'd like some testing on a few different cameras?  Any thoughts on a test suite - sounds like multiple loading & unloading of anything that's done in modules is on order here?  Is it worth running a few Lua programs for test purposes? Doesn't look like you have any VxWorks cams on your personal list but so I assume it would be good to find someone who can test a few of those as I don't either......

I've done a reasonable amount of testing on my cameras - there's nothing that should be camera specific (fingers crossed).

But the changes are not trivial which is why I've created this branch - if anyone wants to try it out that would be very helpful.

I will continue using and testing it until I'm comfortable it's stable enough to merge into the trunk - or someone convinces me it's not worthwhile :)

Quote from: reyalp on 10 / March / 2013, 16:01:10
Quote
There is also a menu option to delete the log file. The log file is always appended to so it can grow out of control if logging is left on. The log also includes a timestamp when the system writes the first entry each time the camera is restarted.
I was going to suggest an option for clearing this at boot, but that would be bad for crash debugging. An option might be to rotate it at boot?

I thought about rotating log files; but decided to keep it simple for now.
The logging option should really only be turned on to help debugging a module problem.

Phil.
Logged
CHDK ports:
  sx30is (1.00c, 1.00h, 1.00l, 1.00n & 1.00p)
  g12 (1.00c, 1.00e, 1.00f & 1.00g)
  sx130is (1.01d & 1.01f)
  ixus310hs (1.00a & 1.01a)
  sx40hs (1.00d, 1.00g & 1.00i)
  g1x (1.00e, 1.00f & 1.00g)
  g5x (1.00c, 1.01a, 1.01b)
  g7x2 (1.01a, 1.01b, 1.10b)
*

Offline srsa_4c

  • ******
  • 4451
Re: Module code V2 - test branch.
« Reply #4 on: 11 / March / 2013, 20:02:42 »
Do I see it correctly that (the infomation about) recreview_hold is not available for modules? The edge overlay module could use it in case of a future improvement. Haven't checked other state variables, but those could be useful too.
Logged
*

Offline philmoz

  • *****
  • 3450
    • Photos
Re: Module code V2 - test branch.
« Reply #5 on: 11 / March / 2013, 20:12:39 »
Quote from: srsa_4c on 11 / March / 2013, 20:02:42
Do I see it correctly that (the infomation about) recreview_hold is not available for modules? The edge overlay module could use it in case of a future improvement. Haven't checked other state variables, but those could be useful too.

It's not currently exported; but it only needs an entry in module_exportlist.c to make it available.

Phil.
Logged
CHDK ports:
  sx30is (1.00c, 1.00h, 1.00l, 1.00n & 1.00p)
  g12 (1.00c, 1.00e, 1.00f & 1.00g)
  sx130is (1.01d & 1.01f)
  ixus310hs (1.00a & 1.01a)
  sx40hs (1.00d, 1.00g & 1.00i)
  g1x (1.00e, 1.00f & 1.00g)
  g5x (1.00c, 1.01a, 1.01b)
  g7x2 (1.01a, 1.01b, 1.10b)
*

Offline lapser

  • *****
  • 1093
Re: Module code V2 - test branch.
« Reply #6 on: 12 / March / 2013, 01:23:22 »
http://www.lua.org/bugs.html#5.2.0

I'm all for updating Lua, especially with the hope of fixing the yield() problem I've been having. It looks like version 5.2 fixed some problems in yield(). I'm not sure if that would fix my yield problem, but it would be another reason to try to update to the latest version of Lua if possible.

If not, I've found a way to avoid the bug that seems to work.
Logged
EOS-M3_120f / SX50_100b / SX260_101a / G1X_100g / D20_100b
https://www.youtube.com/user/DrLapser/videos
*

Offline philmoz

  • *****
  • 3450
    • Photos
Re: Module code V2 - test branch.
« Reply #7 on: 05 / April / 2013, 07:08:04 »
Unless there are any objections, I'm going to merge this into the trunk over the weekend.

Phil.
Logged
CHDK ports:
  sx30is (1.00c, 1.00h, 1.00l, 1.00n & 1.00p)
  g12 (1.00c, 1.00e, 1.00f & 1.00g)
  sx130is (1.01d & 1.01f)
  ixus310hs (1.00a & 1.01a)
  sx40hs (1.00d, 1.00g & 1.00i)
  g1x (1.00e, 1.00f & 1.00g)
  g5x (1.00c, 1.01a, 1.01b)
  g7x2 (1.01a, 1.01b, 1.10b)
*

Offline lapser

  • *****
  • 1093
Re: Module code V2 - test branch.
« Reply #8 on: 05 / April / 2013, 13:50:32 »
Quote from: philmoz on 05 / April / 2013, 07:08:04
Unless there are any objections, I'm going to merge this into the trunk over the weekend.
That would be great. After it's in the trunk, I'll apply my time lapse patches and see if the lua resume() bug is fixed.
Logged
EOS-M3_120f / SX50_100b / SX260_101a / G1X_100g / D20_100b
https://www.youtube.com/user/DrLapser/videos
*

Offline dvip

  • ****
  • 451
Re: Module code V2 - test branch.
« Reply #9 on: 06 / April / 2013, 23:37:46 »
@phil,
Got philmoz-modulesV2@2680 running on both the A590IS and the SX40HS, took some raw shots and no problems.
I couldn't fine the menu item to the CHDK settings menu to allow shortcut keys to be enabled/disabled... I guess this is not there yet.
Logged
Pages: [1] 2 3   Go Up
« previous next »
 

Related Topics