KBNLwikimedia

<< Back to homepage

>> To the Github repo of this page

---

Overview of tools and scripts on Github related to the Wikimedia effort of the KB

GLAMorousToHTML

Creates a datestamped HTML report and a corresponding Excel file listing all Wikipedia articles (in all languages) in which (one or more) images from a given category tree on Wikimedia Commons are used.

• GLAM reports created by this tool
• Github repo
• Tool page on Commons
• Commons category
• Story: Public outreach and reuse of KB images via Wikipedia, 2014-2022

WriteSDoCfromExcel

Adds structured data to files on Wikimedia Commons from an Excel sheet. A Python script that writes Property-Qid pairs from an Excel to the structured data of files on Wikimedia Commons.

• Github repo
• Tool page on Commons
• Structured Data on Commons efforts of the KB

dict2sdc

Import structured data to Wikimedia Commons using Pywikibot. Read data from a dict.csv file and add it as structured data to Wikimedia Commons.

• Github repo
• Structured Data on Commons efforts of the KB

WikimediaKBURLReplacement

Code, scripts and stories about replacing outdated or non-persistent URLs of KB services in Wikipedia, Wikimedia Commons and Wikidata

• Github repo
• Story: Making references to Dutch newspapers in Wikipedia more sustainable

OpenRefine-Wikibase

Files for interaction between OpenRefine and KB Wikibases, for reconciling and uploading data to Wikibases of the KB, using Openfine

• Github repo
• Relevant presentation: Setting up your own Wikibase reconciliation service (e.g. for OpenRefine) (Zenodo, november 2023)

wikipedia-utilities

Utility scripts for working with Wikipedia data dumps

• Github repo

Non-Wikimedia tools, but still handy

SaveToWaybackMachine

Saving URLs of webpages of the KB in bulk to the Wayback Machine of The Internet Archive. Some websites managed by the KB, national library of the Netherlands, have been or will be discontinued. To preserve the content of these sites (e.g. for sourcing Wikipedia articles or cultural heritage preservation purposes) the KB actively submits websites to the The Wayback Machine web.archive.org.

• Github repo

videotools

A collection of video and audio processing tools.

• This repo performs various operations on video and audio files, including:
  • Extracting short video clips from longer ones.
  • Enhancing audio by adjusting pitch and volume, eg. for a deeper voice.
  • Compressing and converting video files to WebM format.
  • Extracting audio from a video and saving it as an MP3 file.
  • Amplifying audio if necessary.
  • Transcribing audio using Whisper.
  • Correcting raw audio transcripts using ChatGPT.
  • Embedding subtitles into the WebM video files.
• Github repo
• Story: How to create high-quality offline video transcriptions and subtitles using Whisper and Python

This site is open source. Improve this page.