LCPQ/spip2md
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Scripts to export the SPIP MySQL database of the current website to plain text Markdown files with YAML front-matter metadata.
262 Commits 2 Branches 0 Tags 1.4 MiB
Python 99.8%
Shell 0.2%
631c168c8c
Go to file
Guilhem Fauré 631c168c8c add option to define a single language of storage, in which files & directories will be written
2023-06-07 17:40:24 +02:00
scripts reorganization 2023-04-21 08:54:41 +00:00
spip2md add option to define a single language of storage, in which files & directories will be written 2023-06-07 17:40:24 +02:00
test init buggy encoding example 2023-05-11 10:23:01 +02:00
.gitignore internal links almost ok + repair û chars + lighter output for unknown chars 2023-05-24 15:32:03 +02:00
LICENSE python project configuration with poetry + update licence 2023-05-26 10:21:44 +02:00
poetry.lock python project configuration with poetry + update licence 2023-05-26 10:21:44 +02:00
pyproject.toml refactor 2023-05-31 12:57:33 +02:00
README.md Unnamed update 2023-06-06 10:46:04 +02:00

README.md

SPIP Database to Markdown

spip2md is a litle Python app that can export a SPIP database into a plain text, Markdown + YAML repository, usable with static site generators.

Features

spip2md is currently able to :

  • Export every section (spip_rubriques), with every article (spip_articles) they contain
    • Replace authors (spip_auteurs) IDs with their name (in YAML block)
    • Generate different files for each language found in <multi> blocks
    • Copy over all the attached files (spip_documents), with proper links
    • Convert SPIP Markup language
    • Convert SPIP ID-based internal links (like <art123>) into path-based, normal links

Usage

To use the app, simply run the command spip2md. However, you probably want to configure certain settings before running it, like the database credentials. Here are the available configuration options, to put in a spip2md.yml file :

db: Name of the database (default is spip)
db_host: Host of the database (default is localhost)
db_user: The database user (default is spip)
db_pass: The database password (default is password)
data_dir: The directory in which SPIP images & files are stored
export_languages: Array of languages to export (default is ["en",])
output_dir: The directory in which files will be written (default is output/)
prepend_h1: Should spip2md prepend the title of articles as Markdown h1 (default true)
prepend_id: Whether to prepend ID of the object to directory slug
prepend_lang: Whether to prepend lang of the object to directory slug
export_drafts: Should we export drafts (default true)
remove_html: Should we clean remaining HTML blocks (default true)
unknown_char_replacement: Broken encoding that cannot be repaired is replaced with that
clear_log: Clear logfile between runs instead of appending to (default false)
clear_output: Clear output dir between runs instead of merging into (default false)
logfile: Name of the logs file (default is spip2md.log)

External links

TODO

These tables could represent additional data to export :

  • spip_evenements
  • spip_meta
  • spip_mots
  • spip_syndic_articles
  • spip_mots_liens
  • spip_zones_liens
  • spip_groupes_mots
  • spip_meslettres
  • spip_messages
  • spip_syndic
  • spip_zones

These tables seem more technical :

  • spip_depots
  • spip_depots_plugins
  • spip_jobs
  • spip_ortho_cache
  • spip_paquets
  • spip_plugins
  • spip_referers
  • spip_referers_articles
  • spip_types_documents
  • spip_versions
  • spip_versions_fragments
  • spip_visites
  • spip_visites_articles

These tables are empty :

  • spip_breves
  • spip_evenements_participants
  • spip_forum
  • spip_jobs_liens
  • spip_ortho_dico
  • spip_petitions
  • spip_resultats
  • spip_signatures
  • spip_test
  • spip_urls