Difference between revisions of "Lyon 2021"
Jump to navigation
Jump to search
(Add another goal for Kiwix-JS) |
(→Budget) |
||
(26 intermediate revisions by 4 users not shown) | |||
Line 5: | Line 5: | ||
=== Offspot === | === Offspot === | ||
* POC Docker common base OLIP/OFFSPOT Renaud/Florian | * POC Docker common base OLIP/OFFSPOT Renaud/Florian | ||
*https://github.com/offspot/kiwix-hotspot/issues/429 | |||
=== Kiwix JS === | === Kiwix JS === | ||
Line 12: | Line 13: | ||
*Backport most of the UI of kiwix-js-windows : Geoffrey/Mossroy | *Backport most of the UI of kiwix-js-windows : Geoffrey/Mossroy | ||
*Switch the default mode to ServiceWorker : Mossroy/Geoffrey | *Switch the default mode to ServiceWorker : Mossroy/Geoffrey | ||
*Discuss a method to read remotely an index (in JS), hard problem of [https://github.com/kiwix/kiwix-js/issues/659 #659] : Kelson/... | |||
=== Libzim === | |||
* [https://github.com/openzim/python-libzim/issues/125 Discuss Hints behavior] | |||
== Achievements == | == Achievements == | ||
==== Offspot-OLIP ==== | |||
* Agreed on [https://etherpad.wikimedia.org/p/oi_docker multi-steps roadmap] to build OLIP and Offspot images from a single toolchain that will ultimately be operated by the Cardshop and/or OLIP Marketplace. | |||
* Agreed on development distribution and schedule (debuts in April 2022) | |||
* Created repositories for [https://github.com/offspot/base-image base-image] and [https://github.com/offspot/image-creator image-creator] | |||
==== Zimfarm ==== | |||
* [https://github.com/kiwix/maintenance/issues/191 New Zimfarm Drive] and move files needed by recipes in it. | |||
==== Kiwix JS ==== | |||
* Latest libzim can now be compiled easily and properly with emscripten. It's ready to be [https://github.com/kiwix/kiwix-build/issues/503 integrated in kiwix-build]. | |||
*A [https://mossroy.github.io/libzim_wasm/ proof of concept] shows that we are able to use this libzim in javascript to read ZIM content, including xapian full-text search. But there is still a limit on the ZIM file size on the emscripten side : we've created [https://github.com/emscripten-core/emscripten/issues/15394 an issue] there, with a simple test-case. | |||
*An incomplete integration of this libzim in kiwix-js is available in [https://github.com/kiwix/kiwix-js/pull/766 a PR], and makes use of libzim to read most content. It works well, but [https://github.com/kiwix/kiwix-js/issues/767 is currently slower] | |||
*[https://github.com/kiwix/kiwix-js/pull/771 A PR] is ready to implement the workaround to use ServiceWorker mode in Firefox extensions, which is a pre-requisite to switch to ServiceWorker mode by default. The PR has still to be polished a bit. | |||
*[https://github.com/kiwix/kiwix-js/issues/404#issuecomment-953606042 A decision] has been made on how to handle external links in ServiceWorker mode (which was also a pre-requisite to switch to ServiceWorker mode by default) | |||
==== openZIM ==== | |||
* Released v7 of [https://github.com/openzim/docker-publish-action docker-publish-action] with webhook support (to trigger auto-deploy on Sloppy) | |||
* Agreement on Hints and impact on suggestion/ft indexes, see [https://github.com/openzim/libzim/issues/642#issuecomment-954062597 openzim/libzim #642] | |||
==== Kiwix-tools ==== | |||
* [https://github.com/kiwix/libkiwix/pull/628 Improve Kiwix-serve Welcome page usability] | |||
==== MWoffliner ==== | |||
* [https://github.com/kiwix/overview/issues/59 Analysed and close a ticket (is invalid) reported by IIAB] | |||
* First experimentation with Windows Subsystem for Linux (Ubuntu). It does not seem to work out of the box because of some kind of conflict around node-gyp. | |||
==== CMS ==== | |||
* Finish to define M0 and M1 | |||
* Progresses on completing M0 | |||
==== Kiwix-Android ==== | |||
* Preparatory work around release of 3.4.7 (migration to Maven, [https://github.com/kiwix/kiwix-android/pull/2727 support of SD card in Android11], recruitement) | |||
==== General ==== | |||
* Make preparatory work to outphase our custom library XML format, see https://github.com/kiwix/overview/issues/59. | |||
=== Libkiwix === | |||
* [https://github.com/kiwix/libkiwix/pull/626 Better handling of metadata] | |||
== Impact == | == Impact == | ||
Line 23: | Line 71: | ||
== Place == | == Place == | ||
The hackathon will take place in Lyon, France in a house located in the [https://en.wikipedia.org/wiki/Vieux_Lyon Saint-Jean District]. Metro: Vieux Lyon ( | The hackathon will take place in Lyon, France in a house located in the [https://en.wikipedia.org/wiki/Vieux_Lyon Saint-Jean District]. Address: 2 Montée du Gourguillon. Metro: Vieux Lyon (there's another entrance further up at 35 Montée du chemin neuf, metro Minimes). | ||
DO NOT FORGET TO BRING AN EXTENSION CORD (and an adaptor if you are not joining for mainland Europe). | |||
== Agenda == | == Agenda == | ||
Line 33: | Line 83: | ||
== People == | == People == | ||
; Travelling | ; Travelling | ||
* Emmanuel | * Emmanuel (8 days) | ||
* Renaud | * Renaud (8 days) | ||
* Geoffrey | * Geoffrey (4 days) | ||
* Florian | * Florian (3 days onsite, the rest remotely) | ||
; Located in Lyon | ; Located in Lyon | ||
* Matthieu | * Matthieu | ||
*Mossroy | * Mossroy | ||
; Visitors | ; Visitors | ||
* Stephane | * Stephane (1 day) | ||
* Grégoire (2 days) | |||
==Budget== | ==Budget== | ||
* Hosting: 2'031.35 | * Hosting: CHF 2'031.35 | ||
* Food: | * Food: CHF 1'622.73 | ||
* Transportation: | * Transportation: CHF 1'657.73 | ||
* Varia: | * Varia (goodies): CHF 316.60 | ||
;Total: CHF 5'628.41 | |||
[[Category:Hackathon | [[Category:Hackathon]] |
Latest revision as of 15:32, 27 February 2023
This page summarizes the action plan for the Kiwix Hackathon Fall 2021.
Goals
Offspot
- POC Docker common base OLIP/OFFSPOT Renaud/Florian
- https://github.com/offspot/kiwix-hotspot/issues/429
Kiwix JS
- Use emscripten to compile and try to use libzim & kiwix-lib : Mossroy/Geoffrey/Matthieu
- Setup infrastructure for i18n of kiwix-js : Geoffrey/Mossroy
- Backport most of the UI of kiwix-js-windows : Geoffrey/Mossroy
- Switch the default mode to ServiceWorker : Mossroy/Geoffrey
- Discuss a method to read remotely an index (in JS), hard problem of #659 : Kelson/...
Libzim
Achievements
Offspot-OLIP
- Agreed on multi-steps roadmap to build OLIP and Offspot images from a single toolchain that will ultimately be operated by the Cardshop and/or OLIP Marketplace.
- Agreed on development distribution and schedule (debuts in April 2022)
- Created repositories for base-image and image-creator
Zimfarm
- New Zimfarm Drive and move files needed by recipes in it.
Kiwix JS
- Latest libzim can now be compiled easily and properly with emscripten. It's ready to be integrated in kiwix-build.
- A proof of concept shows that we are able to use this libzim in javascript to read ZIM content, including xapian full-text search. But there is still a limit on the ZIM file size on the emscripten side : we've created an issue there, with a simple test-case.
- An incomplete integration of this libzim in kiwix-js is available in a PR, and makes use of libzim to read most content. It works well, but is currently slower
- A PR is ready to implement the workaround to use ServiceWorker mode in Firefox extensions, which is a pre-requisite to switch to ServiceWorker mode by default. The PR has still to be polished a bit.
- A decision has been made on how to handle external links in ServiceWorker mode (which was also a pre-requisite to switch to ServiceWorker mode by default)
openZIM
- Released v7 of docker-publish-action with webhook support (to trigger auto-deploy on Sloppy)
- Agreement on Hints and impact on suggestion/ft indexes, see openzim/libzim #642
Kiwix-tools
MWoffliner
- Analysed and close a ticket (is invalid) reported by IIAB
- First experimentation with Windows Subsystem for Linux (Ubuntu). It does not seem to work out of the box because of some kind of conflict around node-gyp.
CMS
- Finish to define M0 and M1
- Progresses on completing M0
Kiwix-Android
- Preparatory work around release of 3.4.7 (migration to Maven, support of SD card in Android11, recruitement)
General
- Make preparatory work to outphase our custom library XML format, see https://github.com/kiwix/overview/issues/59.
Libkiwix
Impact
Method
~ 5 developers meet during a week to make this steps forward.
Place
The hackathon will take place in Lyon, France in a house located in the Saint-Jean District. Address: 2 Montée du Gourguillon. Metro: Vieux Lyon (there's another entrance further up at 35 Montée du chemin neuf, metro Minimes).
DO NOT FORGET TO BRING AN EXTENSION CORD (and an adaptor if you are not joining for mainland Europe).
Agenda
- October 24th (Sunday) afternoon: arrivals (suggested arrival time 5PM)
- October 24th -> October 31th: Kiwix hackathon
- October 31th (Sunday) afternoon: departures (suggested departure time 3PM)
People
- Travelling
- Emmanuel (8 days)
- Renaud (8 days)
- Geoffrey (4 days)
- Florian (3 days onsite, the rest remotely)
- Located in Lyon
- Matthieu
- Mossroy
- Visitors
- Stephane (1 day)
- Grégoire (2 days)
Budget
- Hosting: CHF 2'031.35
- Food: CHF 1'622.73
- Transportation: CHF 1'657.73
- Varia (goodies): CHF 316.60
- Total
- CHF 5'628.41