Difference between revisions of "Hackathon Fall 2021"

From Kiwix
Jump to navigation Jump to search
 
(10 intermediate revisions by 3 users not shown)
Line 27: Line 27:
* Created repositories for [https://github.com/offspot/base-image base-image] and [https://github.com/offspot/image-creator image-creator]
* Created repositories for [https://github.com/offspot/base-image base-image] and [https://github.com/offspot/image-creator image-creator]


==== Zimfarm =====
==== Zimfarm ====


* [https://github.com/kiwix/maintenance/issues/191 New Zimfarm Drive] and move files needed by recipes in it.
* [https://github.com/kiwix/maintenance/issues/191 New Zimfarm Drive] and move files needed by recipes in it.
==== Kiwix JS ====
* Latest libzim can now be compiled easily and properly with emscripten. It's ready to be [https://github.com/kiwix/kiwix-build/issues/503 integrated in kiwix-build].
*A [https://mossroy.github.io/libzim_wasm/ proof of concept] shows that we are able to use this libzim in javascript to read ZIM content, including xapian full-text search. But there is still a limit on the ZIM file size on the emscripten side : we've created [https://github.com/emscripten-core/emscripten/issues/15394 an issue] there, with a simple test-case.
*An incomplete integration of this libzim in kiwix-js is available in [https://github.com/kiwix/kiwix-js/pull/766 a PR], and makes use of libzim to read most content. It works well, but [https://github.com/kiwix/kiwix-js/issues/767 is currently slower]
*[https://github.com/kiwix/kiwix-js/pull/771 A PR] is ready to implement the workaround to use ServiceWorker mode in Firefox extensions, which is a pre-requisite to switch to ServiceWorker mode by default. The PR has still to be polished a bit.
*[https://github.com/kiwix/kiwix-js/issues/404#issuecomment-953606042 A decision] has been made on how to handle external links in ServiceWorker mode (which was also a pre-requisite to switch to ServiceWorker mode by default)
==== openZIM ====
* Released v7 of [https://github.com/openzim/docker-publish-action docker-publish-action] with webhook support (to trigger auto-deploy on Sloppy)
* Agreement on Hints and impact on suggestion/ft indexes, see [https://github.com/openzim/libzim/issues/642#issuecomment-954062597 openzim/libzim #642]
==== Kiwix-tools ====
* [https://github.com/kiwix/libkiwix/pull/628 Improve Kiwix-serve Welcome page usability]
==== MWoffliner ====
* [https://github.com/kiwix/overview/issues/59 Analysed and close a ticket (is invalid) reported by IIAB]
* First experimentation with Windows Subsystem for Linux (Ubuntu). It does not seem to work out of the box because of some kind of conflict around node-gyp.
==== CMS ====
* Finish to define M0 and M1
* Progresses on completing M0
==== Kiwix-Android ====
* Preparatory work around release of 3.4.7 (migration to Maven, [https://github.com/kiwix/kiwix-android/pull/2727 support of SD card in Android11], recruitement)
==== General ====
* Make preparatory work to outphase our custom library XML format, see https://github.com/kiwix/overview/issues/59.
=== Libkiwix ===
* [https://github.com/kiwix/libkiwix/pull/626 Better handling of metadata]


== Impact ==
== Impact ==

Latest revision as of 16:27, 1 November 2021

This page summarizes the action plan for the Kiwix Hackathon Fall 2021.

Goals

Offspot

Kiwix JS

  • Use emscripten to compile and try to use libzim & kiwix-lib : Mossroy/Geoffrey/Matthieu
  • Setup infrastructure for i18n of kiwix-js : Geoffrey/Mossroy
  • Backport most of the UI of kiwix-js-windows : Geoffrey/Mossroy
  • Switch the default mode to ServiceWorker : Mossroy/Geoffrey
  • Discuss a method to read remotely an index (in JS), hard problem of #659 : Kelson/...

Libzim

Achievements

Offspot-OLIP

  • Agreed on multi-steps roadmap to build OLIP and Offspot images from a single toolchain that will ultimately be operated by the Cardshop and/or OLIP Marketplace.
  • Agreed on development distribution and schedule (debuts in April 2022)
  • Created repositories for base-image and image-creator

Zimfarm

Kiwix JS

  • Latest libzim can now be compiled easily and properly with emscripten. It's ready to be integrated in kiwix-build.
  • A proof of concept shows that we are able to use this libzim in javascript to read ZIM content, including xapian full-text search. But there is still a limit on the ZIM file size on the emscripten side : we've created an issue there, with a simple test-case.
  • An incomplete integration of this libzim in kiwix-js is available in a PR, and makes use of libzim to read most content. It works well, but is currently slower
  • A PR is ready to implement the workaround to use ServiceWorker mode in Firefox extensions, which is a pre-requisite to switch to ServiceWorker mode by default. The PR has still to be polished a bit.
  • A decision has been made on how to handle external links in ServiceWorker mode (which was also a pre-requisite to switch to ServiceWorker mode by default)

openZIM

Kiwix-tools

MWoffliner

CMS

  • Finish to define M0 and M1
  • Progresses on completing M0

Kiwix-Android

General

Libkiwix

Impact

Method

~ 5 developers meet during a week to make this steps forward.

Place

The hackathon will take place in Lyon, France in a house located in the Saint-Jean District. Address: 2 Montée du Gourguillon. Metro: Vieux Lyon (there's another entrance further up at 35 Montée du chemin neuf, metro Minimes).

DO NOT FORGET TO BRING AN EXTENSION CORD (and an adaptor if you are not joining for mainland Europe).

Agenda

  • October 24th (Sunday) afternoon: arrivals (suggested arrival time 5PM)
  • October 24th -> October 31th: Kiwix hackathon
  • October 31th (Sunday) afternoon: departures (suggested departure time 3PM)

People

Travelling
  • Emmanuel
  • Renaud
  • Geoffrey
  • Florian (3 days onsite, the rest remotely)
Located in Lyon
  • Matthieu
  • Mossroy
Visitors
  • Stephane
  • Grégoire

Budget

  • Hosting: 2'031.35 CHF
  • Food:
  • Transportation:
  • Varia: