Athens 2023

This page summarizes the plans for the Kiwix Hackathon 2023 in Athens (to not be confused with Hackathon 2023 Paris.

Date & Venue

From Thursday 18 May (evening) to Friday 26 May (morning) in Athens (we have rent a flat).

Logistics

DO NOT FORGET TO BRING AN EXTENSION CORD (and an adapter if you are not joining from mainland Europe).

FYI Greece uses the same C, E and F sockets as the rest of Europe.

Goals

The main goal of the hackahton is to focus on Zimit and all its software stack: Browsertrix, warc2zim, python-libzim, ...

We want to prepare next big iteration on Zimit, considering that current version is the result of of the first iteration of 2020-21.

We need to (does not have to be in this order):

• Assess current situation
  • Present Webrecorder/Kiwix current activities and projects
  • Present current sofware stack and how it interacts together
  • List and identify the weaknesses (at least the one not clearly identify already) in the current architecture/software
  • Assess list of weaknesses reported by Jaifroid
  • Go over the crawler's CLI params to understand how/when to use them (docker run --rm -it ghcr.io/openzim/zimit:dev crawl --help)
  • Status of Success status code on failure
  • Status of Disable browser updates Fixed in Zimit, but not yet upstream in Browsertrix
  • Status of SSLError
  • First access to warc2zim file doesn't correctly catch external links

• Agree on future features/architecture
  • Get WACZ presented and decided if we should use it
  • How communicate to a user the boundaries of a ZIM?
  • Should we still use Service workers?
  • What kind of size optimisation should we run?
  • Assess pseudo namespaces
  • Should we accept invalid HTTPs?

• Fix current bugs and weaknesses
  • Incorrect relative URLs on top-level landing pages
  • Out of scope homepage redirect
  • See how to simplify/improve Wabac ZIM related part
  • Can't clear options

• Implement new features
  • Better SW non-supported page
  • Implement --insecure command line argument
  • Add support for Linux/Arm64
  • Introduce E2E automated testing
• Work on agreed implementation in readers that currently don't support Zimit/WARC
  • Kiwix JS

Agenda

From Friday to Sunday there is the Wikimedia Hackathon for which at least Matthieu and Kelson has registered.

After that we will be all gathered to focus on Zimit.

Attendees

Kiwix

• Reg (remote)
• Kelson
• MGauthier
• Jaifroid

Webrecorder

• Ilya (maybe)