{"id":45,"date":"2019-02-01T08:00:00","date_gmt":"2019-02-01T08:00:00","guid":{"rendered":"http:\/\/wcwp.rf.gd\/2019\/02\/01\/https-landscapearchaeology-org-2019-frontmatter\/"},"modified":"2019-02-01T08:00:00","modified_gmt":"2019-02-01T08:00:00","slug":"frontmatter","status":"publish","type":"post","link":"https:\/\/landscapeanalysis.org\/?p=45","title":{"rendered":"Bulk editing posts for Jekyll"},"content":{"rendered":"

This website is generated by Jekyll<\/a>, a static site generator. Static sites do not require complex backend engines, such as databases and software which recreate site content for each visitor. It\u2019s just static files. This translates into a) free hosting (it\u2019s cheap to host static files), b) super-fast websites (no software grinding behind) and c) less energy consumption. But it also implies the maintainer doing much of the work that is normally delegated to machines.<\/p>\n

Jekyll is for geeks, even if you may read otherwise on the net, no buttons and check boxes here. Managing the content can easily become a pain, especially when we start to deal with larger numbers of articles. These are all just text files sitting on the disk. A typical problem is to remove or to add tags to existing articles. As sites evolve, we introduce new tags and reorganise the old ones.<\/p>\n

There is a solution for the management of Jekyll posts in the form of a small Python library called frontmatter<\/a>. To install just do:<\/p>\n

\n
\n
pip<\/span> install<\/span> python<\/span>-<\/span>frontmatter<\/span>\n<\/code><\/pre>\n<\/div>\n<\/div>\n
This library can edit data fields in post heading (YAML format) and read post contents. That\u2019s perfect for our problem of bulk editing tag fields, we just need to loop through posts and assign\/remove tags. This is a script I came up with:<\/p>\n
\n
\n
import<\/span> frontmatter<\/span>\nfrom<\/span> os<\/span> import<\/span> listdir<\/span>\nfrom<\/span> os.path<\/span> import<\/span> isfile<\/span>,<\/span> join<\/span>\n\nimport<\/span> codecs<\/span> #this is nasty...\n<\/span>\n\"\"\"\nBulk edit function for tags in Jekyll posts. \n\nThe script will attempt to edit and OVERWRITE ALL FILES \nin the specified folder: \nyou should place selected files in a temporary folder. \n\"\"\"<\/span>\n\n# -------  INPUT PARAMETERS --------------\n<\/span>\n# TEMPORARY folder with selected files \n# (do not specify the main _posts folder!)\n<\/span>folder<\/span> =<\/span> '__path__to__my__temporary__folder__'<\/span>\n\nadd_tag<\/span> =<\/span> 'qgis'<\/span> #tag to be insereted\n<\/span>\nremove_tag<\/span>=<\/span> ''<\/span> #tag to be removed\n<\/span>\n# ----------- ENGINE --------------------\n<\/span>\nfor<\/span> f<\/span> in<\/span> listdir<\/span>(<\/span>folder<\/span>):<\/span>\n\n    file<\/span> =<\/span> join<\/span> (<\/span>folder<\/span>,<\/span> f<\/span>)<\/span>\n\n    if<\/span> not<\/span> isfile<\/span>(<\/span>file<\/span>):<\/span> continue<\/span>\n\n    print<\/span> (<\/span>file<\/span>)<\/span>\n\n    post<\/span> =<\/span> frontmatter<\/span>.<\/span>load<\/span> (<\/span>file<\/span>)<\/span>\n\n    #print (post['title'])\n<\/span>\t\n    if<\/span> remove_tag<\/span> :<\/span>\n        try<\/span>:<\/span>  post<\/span>[<\/span>'tags'<\/span>].<\/span>remove<\/span>(<\/span>remove_tag<\/span>)<\/span>\n        except<\/span>:<\/span> pass<\/span>\n\n    if<\/span> add_tag<\/span>:<\/span>\n        try<\/span>:<\/span>\n            if<\/span> add_tag<\/span> not<\/span> in<\/span> post<\/span>[<\/span>'tags'<\/span>]<\/span> :<\/span>\n                post<\/span>[<\/span>'tags'<\/span>]<\/span> +=<\/span> [<\/span>add_tag<\/span>]<\/span>\n        except<\/span>:<\/span>\n            # tags do not exist yet\n<\/span>            post<\/span>.<\/span>metadata<\/span>[<\/span>'tags'<\/span>]<\/span> =<\/span> [<\/span>add_tag<\/span>]<\/span>\n\n  \n\t# this is the output in text format\n<\/span>    out<\/span> =<\/span> frontmatter<\/span>.<\/span>dumps<\/span>(<\/span>post<\/span>)<\/span>\n\n    # https:\/\/stackoverflow.com\/questions\/934160\/write-to-utf-8-file-in-python\/934203#934203\n<\/span>    o<\/span> =<\/span> codecs<\/span>.<\/span>open<\/span>(<\/span>file<\/span>,<\/span> 'w'<\/span>,<\/span> 'utf-8'<\/span>)<\/span>\n    o<\/span>.<\/span>write<\/span>(<\/span>out<\/span>)<\/span>\n    o<\/span>.<\/span>close<\/span>()<\/span>\n<\/code><\/pre>\n<\/div>\n<\/div>\n
IMPORTANT: the script will attempt to edit all files in a folder, there is no particular filter or whatever. You should never run it inside the main folder containing original posts. Copy selected posts to a temporary folder, edit, check and then paste back to the main _posts<\/em> folder (or wherever these may be placed).<\/p>\n
Note that data fields are represented as keys in a dictionary, which is handy ( print<\/span> (<\/span>post<\/span>[<\/span>'title'<\/span>])<\/span><\/code> ). This script can be extended for other data fields (date, author name, title etc\u2026).<\/p>\n","protected":false},"excerpt":{"rendered":"
This website is generated by Jekyll, a static site generator. Static sites do not require complex backend engines, such as databases and software which recreate site content for each visitor. It\u2019s just static files. This translates into a) free hosting (it\u2019s cheap to host static files), b) super-fast websites (no software grinding behind) and c) […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[8],"class_list":["post-45","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-code"],"_links":{"self":[{"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=\/wp\/v2\/posts\/45","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=45"}],"version-history":[{"count":0,"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=\/wp\/v2\/posts\/45\/revisions"}],"wp:attachment":[{"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=45"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=45"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/landscapeanalysis.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=45"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}