Blogs & essays

Point OpenWiki at an article and it keeps only the part worth reading. It finds the main <article>, drops navigation and footers, and detects the title and publish date.

$ openwiki essay --url https://www.paulgraham.com/greatwork.html --folder Essays --id-prefix pg

Follow a whole blog

Add the blog's index page to sources.json. Each time you run openwiki sync, only new posts are downloaded.

// sources.json
{ "essay_sources": [{
  "name": "Some Blog", "kind": "generic",
  "index_url": "https://example.com/blog/",
  "base_url": "https://example.com/blog",
  "folder": "Some Blog", "id_prefix": "sb"
}] }

The generic parser follows same-site links under base_url and ignores feeds, images and PDFs. There are dedicated parsers for Paul Graham and Sam Altman, and adding one for another site takes a few lines.

Next

Mix essays with video transcripts and your own notes in the same wiki.