KBNLwikimedia
| << Back to homepage | >> To the Github repo of this page |
Overview of tools and scripts on Github related to the Wikimedia effort of the KB
Wikimedia Commons tools
GLAMorousToHTML
Creates a datestamped HTML report and a corresponding Excel file listing all Wikipedia articles (in all languages) in which (one or more) images from a given category tree on Wikimedia Commons are used.
- GLAM reports created by this tool
- Github repo
- Tool page on Commons
- Commons category
- Story: Public outreach and reuse of KB images via Wikipedia, 2014-2022
Prototype: Wikipedia ❤️ Delpher - Portrait explorer, a visual exploration of notable individuals in Wikipedia, illustrated by Delpher.
It allows you to explore humans who are described in Wikipedia articles illustrated by Delpher images. You can do so by occupation, gender, country of citizenship, decades of birth and death and Wikipedia language version. For instance: a female opera singer from France born in the 1880s described by a Wikipedia article in French.
Wikimedia Commons File Metadata Downloader
Collect metadata from Wikimedia Commons files or categories and write them into an Excel sheet — safely, in chunks, and with per-file JSON snapshots.
Wikimedia Commons File Downloader
A robust, Windows-safe downloader for Wikimedia Commons files - Download Wikimedia Commons files by nested category tree or flat list, preview before downloading, slice a subset, use Windows-safe unique filenames, and log to Excel.
Wikimedia Commons URL M-ID Excel Extractor
Reads a Wikimedia Commons FileURL column from an Excel sheet, looks up the corresponding MediaInfo entity IDs (M-IDs), and writes the results back into the same Excel workbook.
Wikimedia Commons copyright template extractor
Identifies public domain (PD) or PD-like (Creative Commons) license templates in Wikimedia Commons files, alongside simplified creation/publication dates.
- Github repo
- Story: Free to use? Exploring public domain claims in Wikimedia Commons files sourced from Delpher (June 2025)
Wikimedia Commons structured data tools
Code, scripts and stories about dealing with structured data for KB files on Wikimedia Commons.
More info about Structured Data on Commons efforts of the KB.
- Wikimedia Commons category Depicts (P180) extractor
Lists all things depicted in all images in a Wikimedia Commons category
- WriteSDoCfromExcel
Adds Wikidata QIDs to the structured data for one or more properties (e.g., P180 – depicts, P170 – creator) on Wikimedia Commons files from an Excel sheet.
- Delpher-Commons structured data tools - TO UPDATE!!
Tools to add, update, improve an manage structured data for Delpher files on Wikimedia Commons
- Github repo
- To add: extract-delpher-urls-from-wikitext.py
- To add: add-delpher-urls-to-sdc.py
- dict2sdc
Import structured data to Wikimedia Commons using Pywikibot. Read data from a dict.csv file and add it as structured data to Wikimedia Commons.
Other Wikimedia tools
WikimediaKBURLReplacement
Code, scripts and stories about replacing outdated or non-persistent URLs of KB services in Wikipedia, Wikimedia Commons and Wikidata
OpenRefine-Wikibase
Files for interaction between OpenRefine and KB Wikibases, for reconciling and uploading data to Wikibases of the KB, using Openfine
- Github repo
- Relevant presentation: Setting up your own Wikibase reconciliation service (e.g. for OpenRefine) (Zenodo, november 2023)
wikipedia-utilities
Utility scripts for working with Wikipedia data dumps
Non-Wikimedia tools, but still handy
TO ADD: General File Downloader
A simple tool for quickly downloading non-Wikimedia Commons files
TO ADD: URL http status checker
Checks the HTTP status codes of a list of URLs, with support for retries, timeouts, and detailed logging. Works for all URLs, not necessarily Wikimedia-related URLs.
SaveToWaybackMachine
Saving URLs of webpages of the KB in bulk to the Wayback Machine of The Internet Archive. Some websites managed by the KB, national library of the Netherlands, have been or will be discontinued. To preserve the content of these sites (e.g. for sourcing Wikipedia articles or cultural heritage preservation purposes) the KB actively submits websites to the The Wayback Machine web.archive.org.
videotools
A collection of video and audio processing tools.
- This repo performs various operations on video and audio files, including:
- Extracting short video clips from longer ones.
- Enhancing audio by adjusting pitch and volume, eg. for a deeper voice.
- Compressing and converting video files to WebM format.
- Extracting audio from a video and saving it as an MP3 file.
- Amplifying audio if necessary.
- Transcribing audio using Whisper.
- Correcting raw audio transcripts using ChatGPT.
- Embedding subtitles into the WebM video files.
- Github repo
- Story: How to create high-quality offline video transcriptions and subtitles using Whisper and Python