Stockholm (Wikimania) 2019

This page summarizes the action plan for the Kiwix Wikimania 2019 Hackathon.

Goals

Kiwix

Build

• Explain all the build system and its integration in the CI.

Lib

• Discuss (and hopefully decide) about tag/name management of zim file (https://github.com/kiwix/kiwix-lib/issues/131 and associated issues)

• Discuss about the server integration (if not done since)

Tools

• Look the best tool to analyze activity of all kiwix's Github projects (try to use GrimoireLab) and deploy a first version to test this - Florent

Android

• See about the wrapper about the Library/Server of kiwix-lib.

Hotspot

• Make Kiwix-Hotspot running in RPI0 - Renaud
• Prepare presentation - Kelson, Renaud

WP1 Bot

• Make a Docker image of the update part - Kelson
• Try to convert Update -> Releases to Python - Travis
• Set up travis-ci for the bot's github project - Travis
• Develop scheduling infrastructure for update part - Travis
• Convert upload part to Python with tests - Travis
  • Refactor/reorganize project code to maintain logical organization - Travis
• Develop plan for web app - Travis

Other scrapers

• Planning of FO requests - Kelson, Renaud, Joe
• Fixing many problems in zip2zim - Joe
• Revamping phets scraper - Joe

Other

• Cleaning of Kiwix wiki - Kelson
• Managing the logistic of the hackathon - Kelson

Achievements

Kiwix

Android

• Worked on integrating kiwix-lib changes to allow stack overflow ZIMs and others with redirects to work on Android. - Isaac
• Fixed various bugs relating to the bottom navigation bar. - Isaac
• Worked out a new way to build with local kiwix-lib. - Isaac
• Fixed various bugs with the home screen. - Siddharth
• Worked on integrating the wifi hotspot of kiwix-android with kiwix-serve. - Abdul and Siddharth
• Fixed bugs in the tab switcher. - Abdul
• Enabled Kiwix+LeakCanary to be tested using Android Robot (which already exposed some crashes in the app) - Julian
• Documented, tested and slightly improved the Custom Android App build process - Julian
• Started fixing some flaws in the app when it's run as a custom app. - Julian
• Found several bugs with the Notes feature - in custom apps it crashed, and on older devices the text is almost white on a white background - Julian
• Worked with Abdul to find the causes for 2 of the top crashes as reported in Android Vitals - Julian
• Did some testing using Android Monkey, too early to provide definitive analysis, I'm continuing to test using Monkey post hackathon and will report findings separately - Julian
• Prepare 2.5.3 release - Abdul

libkiwix

• Make a decision about how to test cutting-edge libkiwix against kiwix-android, here and here Kelson (talk)
• Introduce HTTP service in the libkiwix (from kiwix-serve) - Matthieu

Kiwix-hotspot

• Fixed homepage icon for some ZIMs (work around zimwriterfs bug) – renaud
• Released version 2.0.8
• Updated Support Files wiki (build instructions for pi0-4 on with newer kernel) - renaud
• Switched to latest raspbian image (buster) - renaud
• Added support for Pi4

Maintenance

• Fixing zimquarantine - Florent

Openzim

libzim

• Discuss a few possible paths of optimization of the libzim and open tickets: here and here. Kelson (talk)
• Introduce support of new Flavour Metadata Kelson (talk)

zim-tools

• Release of version 1.0.4 Kelson (talk) 14:11, 10 August 2019 (UTC)

zimwriterfs

• Fix regression related to favicon redirect writing Kelson (talk), renaud
• Introduce flavour Medata writing Kelson (talk), renaud
• Introduced scraper parameter to set metadata - renaud
• Rewrite the Dockerfile to allowing copying the src code directly from the repository Kelson (talk), renaud
• New release 1.3.5 Kelson (talk)
• Fixed how relative URLs in CSS are rewritten

MWoffliner

• Fix problem with Wrong description Kelson (talk)
• Add support of new ZIM metadata Flavour Kelson (talk)

WP1 engine

• Many changes to make the project more newcomers friendly. Emmanuel
• Setup Docker & deploy it. Travis, Emmanuel
• Setup Codefactor & Codecoverage, Emmanuel
• Setup CI with automated testing, Travis
• Wrote upload tables code, with tests. Travis
• Setup rq job queueing/worker code for update/upload portion. Travis
• Implement update logs. Travis
• Setupe infrastructure for Web service (milestone 3). Travis

Gutenberg scraper

• Fixed scraper and make it zimfarm compatible

Zimfarm

• Added support for gutenberg scraper
• rescheduled everything with new aliased format

Others

• Make decision on Categories & Tags approach Renaud, Matthieu, Emmanuel

Organization

The hackathon took place at Stockholm University as part of Wikimania 2019.

Agenda

Arrival: Friday 9 August afternoon

Departure: Sunday 18 August.

Hosting

We will be hosted at The Red Boat in Stockholm (map).

Room are reserved:

• Abdul + Siddharth: From Thursday 8th to Tuesday 20th
• Matthieu: From Friday 9th to Friday 16th
• Emmanuel + Renaud, Isaac + Joe, Florent: From Friday 9th to Sunday 18th

Julian and Travis have external accommodations.

Budget

• Hosting: CHF 6'500.-
• Transportation: CHF 6'000.-
• Food: CHF 5'000.-
• Varia (unplanned, incidentals, goodies) 20%: CHF 2'500.-

Total

CHF 20'000.-

Invitees / Attendees

• Emmanuel
• Matthieu
• Renaud
• Isaac
• Abdul
• Siddharth
• Joe
• Travis
• Julian
• Florent