Workshop outline and notes
Latest update: 21 November 2019
Module 1: Basic flat & layered maps
Prerequisites for this Module
If you do not have, or cannot create such a Wikidata set, you can use one of these:
1) Public libraries in The Netherlands (incomplete set, per 21-11-2019)
2) National heritage sites of the Netherlands (limited to 1000 items)
3) Big cities in the world
4) Volcanos
5) Airports around the equator ( between -10 and +10 degrees latitude)
Many examples in this workshop are based on the first dataset Public libraries in The Netherlands
Module 1.1 Basic flat map
- Public libraries in The Netherlands: https://w.wiki/6dx
- Default map view: https://w.wiki/6eq
- Relation between query and popup
- Hiding fields from popup: https://w.wiki/6mU
Module 1.2 Clustered flat map
- Clustered flat map: https://w.wiki/6ew
Module 1.3 Basic layered map
- Dutch public libraries, layered by province: https://w.wiki/6gJ - With non-custom layer names, the layer names are the labels from the Wikidata items
Module 1.4 Layered map, custom layer names
- Libraries layered by postal code zone: https://bit.ly/3368DPk
Module 1.5 Other cool layered maps
- Big cities, by population: https://w.wiki/AaA
- Disasters, by type: https://w.wiki/6gY
- Medieval churches, by century of construction: https://w.wiki/6ga
- Dutch municipalities, by number of public libraries: https://w.wiki/6gb
Prerequisites for this Module (in addtition to those in Module 1)
- User page on Wikipedia, Wikimedia Commons or Wikidata (example)… With Sandbox
Nice to have some knowledge about
For embedding maps we’ll be using the Mediawiki Kartographer extension
All embedding examples below are available on https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019
Basic map
- Basic embedded map of The Netherlands, no data: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/0 (View source)
Module 2.1 Single location, hard-coded
- One public library in Amsterdam, geo coordinates hard-coded: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/1. (View source)
- Styling of markers https://github.com/mapbox/simplestyle-spec/tree/master/1.1.0#3-client-behavior and https://www.mediawiki.org/wiki/Help:Extension:Kartographer
Module 2.2 Three locations, hard-coded
Module 2.3 Outline (GeoShape) via Wikidata & OpenStreetMap
- Outline (GeoShape) of Amsterdam public library OBA Oosterdok, using Wikidata and Open Street Map: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/3. (View source)
- Wikidata item of Amsterdam Public Library OBA Oosterdok: https://www.wikidata.org/wiki/Q50413436
- OBA Oosterdok on OSM: https://www.openstreetmap.org/way/240467636#map=19/52.37605/4.90853. Notice the Wikidata=Q50413436 in the tags on the left hand side.
Module 2.4 Many locations, GeoJSON .map file
- Map of Dutch public libraries: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/4. (View source)
- Corresponding .map file on Wikimedia Commons: https://commons.wikimedia.org/wiki/Data:DutchPublicLibraries.map (View source)
- Help: Map Data: https://www.mediawiki.org/wiki/Help:Map_Data
- http://geojson.io
- SPARQL query to make .tsv file as input for Geojson.io: https://bit.ly/2YG48aY. Don’t forget to rename the headers (replace ‘_’ with ‘-‘)
Module 2.5 Combining data types
- https://www.mediawiki.org/wiki/Help:Extension:Kartographer#Combining_multiple_data_types
- Combining GeoShape (with geomask) and .map: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/5. (View source)
- Map of public libraries in the Dutch province of North-Holland: https://commons.wikimedia.org/wiki/Data:DutchPublicLibrariesNorthHolland.map
Module 2.6 GeoShapes using SPARQL and OSM
- https://www.mediawiki.org/wiki/Help:Extension:Kartographer#GeoShapes_via_Wikidata_Query
- Map with GeoShapes based on SPARQL queries in Wikidata: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/6. (View source)
- Note: in the source code of this map all newlines need to be stripped from the SPARQL query, otherwise the map gets broken. See https://phabricator.wikimedia.org/T214984 Do I get this right, to make the following showcase map work without Lua, now there isn’t a more readable way than removing all newlines from SPARQL?
- GeoShape of Libya (Q1016) on OSM: https://www.openstreetmap.org/relation/192758#map=5/22.086/20.039
- SPARQL query to generate GeoShapes of African countries: https://bit.ly/2YBxV4t
- Variables must have names ?id ?title ?description ?fill ?stroke
- In the SPARQL query only use single quotes, otherwise you’ll get a JSON parse error
Module 2.7 Other cool embedded maps
- Railway lines around Klang Valley, Malaysia: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/7. (View source)
- Governors of US states with their party affiliation: https://www.mediawiki.org/wiki/Help:Extension:Kartographer#/map/4 and https://www.mediawiki.org/wiki/Help:Extension:Kartographer#GeoShapes_via_Wikidata_Query
- Examples by Simon Cobb: https://www.wikidata.org/wiki/User:Sic19#GeoShapes
Module 3 : Interactive, layered off-Wiki maps driven by Wikidata
Prerequisites for this Module (in addtition to those in Modules 1 and 2)
- Mediawiki account - https://www.mediawiki.org
Nice to have basic working knowledge about
- Python
- PAWS / Jupyter Notebooks: https://www.mediawiki.org/wiki/PAWS + https://realpython.com/jupyter-notebook-introduction/
And nice to have heard about
- Jupyter-Leaflet: https://github.com/jupyter-widgets/ipyleaflet + https://ipyleaflet.readthedocs.io/en/latest/
- Jupyter-widgets: https://github.com/jupyter-widgets/ipywidgets + https://ipywidgets.readthedocs.io/en/latest/
Module 3.1 Introduction to PAWS // Getting PAWS up and running
- Important PAWS pages: https://www.mediawiki.org/wiki/PAWS + https://www.mediawiki.org/wiki/Manual:Pywikibot/PAWS + https://wikitech.wikimedia.org/wiki/PAWS
- Starting your PAWS server: https://paws.wmflabs.org/paws/hub + https://paws.wmflabs.org/paws/hub/user/USERNAME
- Running your PAWS server: https://paws.wmflabs.org/paws/user/USERNAME/tree
- Your PAWS terminal(s): https://paws.wmflabs.org/paws/user/USERNAME/terminals/1 (/2, /3, /4 etc for additional terminals)
- Stopping your PAWS server: https://paws.wmflabs.org/paws/hub/home
- Your PAWS public folder (even when server is offline) https://paws-public.wmflabs.org/paws-public/User:USERNAME
- PAWS alternative, local Jupyter Notebook installation via Anaconda: https://jupyter.org/install + https://dataiseasy.com/2019/03/how-to-install-anaconda-and-jupyter-notebook
Module 3.2 Installing example notebook
- Go to PAWS public folder of User:OlafJanssen: https://paws-public.wmflabs.org/paws-public/User:OlafJanssen
- Go to folder WikidataMapMakingWorkshop
- Save raw json file WikidataMapMakingWorkshop.ipynb to your PC: https://paws-public.wmflabs.org/paws-public/User:OlafJanssen/WikidataMapMakingWorkshop/WikidataMapMakingWorkshop.ipynb?format=raw
- Upload this raw json file to your own PAWS server
- Example notebook to play around with on your own server: https://paws.wmflabs.org/paws/user/USERNAME/notebooks/WikidataMapMakingWorkshop.ipynb
Module 3.3 Adapt example notebook, create your own interactive layered map
- Full instructions are given in the notebook. The notebook should be self-explanatory, so adapt, play, understand, get frustrated, learn…. Make your own interactive, layered map
- The resulting map from the default notebook looks like this:
Module 3.4 Save your map for off-Wiki use
- Exporting the map to stand-alone off-Wiki HTML file: https://ipywidgets.readthedocs.io/en/latest/embedding.html#python-interface
- The addition of
python state=dependency_state([m]) keeps the html file growing too large
- Python code:
python embed_minimal_html('NetherlandsPublicLibrariesHeatmap.html', views=[m], state=dependency_state([m]), title='Heat map of Dutch public libraries, Wikimania map making workshop, 18th August 2019')
- Off-Wiki version of NetherlandsPublicLibrariesHeatmap.html
Feedback
Feedback on this workshop is more than welcome, please let me know your suggestions, improvements, dislikes etc.