How I publish Nuggets directly from RoamResearch to Dev.to

Jan 22 '21

Fun Fact This article has been written entirely in RoamResearch in order to test the efficacy of my setup ✌🏻 SO META 🤓

RoamResearch is the best tool I have discovered in the last year. Over time, it has been the main driver for improving my productivity (or at least perceived productivity 😅). I use it for note-taking, project management, planning, journaling, habit tracking (still need to figure out a good system for this, suggestions welcome 🙏🏻), and thanks to an awesome chrome extension, I am already tweeting from it 🤩

Amin Benselim

@aminbenselim

testing out Mercury extension to tweet from my #roam database 😍chrome.google.com/webstore/detai…
Now if only I can slack and use VsCode from Roam I would gladly spend my day Roaming 😅

10:43 AM - 05 Jan 2021

One of my goals in 2021 is to share my knowledge and engage with online communities. Since I am already accumulating knowledge in RoamResearch, and to reduce context switching, whenever I have an idea for a Nugget, I want to write it down immediately. My roam DB is open at all times, so it feels like the most natural and fastest way for me to write my idea down before I get distracted or lose focus. 🤓

Furthermore, The notes I write in Roam have backlinks, which helps me with discoverability and serendipity. I then have a SmartBlock that takes advantage of roam42 converter [1] to convert the text to markdown and strip the links from it. For example, for this article, here is how it looks from inside RoamResearch (Again, SO META 🤓)

Finally, I like carving out my own solutions to already solved problems.

Inspired by David Bieber Snippets [0], I wanted to create a system that allows me to share any bit of knowledge from RoamResearch to dev.to. Why call them Nuggets? Well, I didn't want to also call them Snippets 😈 But most importantly, take a look at the definition of a golden nugget in Wikipedia

A gold nugget is a naturally occurring piece of native gold. Watercourses often concentrate nuggets and finer gold in placers. Nuggets are recovered by placer mining, but they are also found in residual deposits where the gold-bearing veins or lodes are weathered. Nuggets are also found in the tailings piles of previous mining operations, especially those left by gold mining dredges.

For me, a Nugget is a raw piece of knowledge, rough and unedited. Either newly discovered or formed and synthesised as a residue from my previously collected knowledge

I chose dev.to for two reasons:

dev.to is a great online community geared towards developers, it is very fitting for the content I want to produce which is going to be mainly technical.
It has an awesome API that allows me to post articles to the platform. I also have a personal website that syncs with my published articles in dev.to using a webhook (still work in progress. I will publish an article about the process once I am done with it ✌🏻)

Here is now an explanation of how my process works

Create a Smart Block to generate a Nugget

This is a simple smart block that does the following

Add tag reference to Nugget pages. this is important for me in order to keep track of all the published Nuggets inside my graph
Use the --- separator to create a section for the Front-matter attributes
For the title and the tags, I use the <%INPUT%> SmartBlock
I then place the cursor after the separator to signify the start of the Nuggets body
Note: because of some limitations and gotchas in the syntax (which I will talk about later), I am not yet confident to directly publish the article so I create it as a draft (published: false)

Create a SmartBlock to publish my article to dev.to

This SmartBlock is mainly in javascript, it gets the children blocks and takes advantage of roam42 helper functions to convert it to Github markdown

Github flavoured markdown has differences with the syntax dev.to uses, so I had to do the following changes
- Change Twitter, Youtube, StackOverflow and StackExchange links from markdown to LiquidTags syntax [2]
- I learned that highlights denoted by ^^ is not part of markdown syntax [3] So I had to change them to HTML <mark>
One other "limitation" I noticed is that If you don't have an empty line at the end of a code block, it will not render properly.
One last thing, dev.to does not allow to publish from the frontend due to CORS issues, you need to create a proxy server to the api. I created a simple node.js server you can see here

I have created an issue with the SmartBlock if you want to use it 🙏🏻

Publish Roam page to dev.to #191

amine-benselim posted on Jan 22, 2021

✂️ Copy of your #42SmartBlock from Roam

#42SmartBlock Publish Nugget

<%JAVASCRIPTASYNC:```javascript
// Get the page block uid 
const pageUid = window.location.href.split('/').reverse()[0];
// Walk the blocks tree and generate markdown using roam42 helper functions
let md = await roam42.formatConverter.iterateThroughTree(pageUid, roam42.formatConverter.formatter.markdownGithub);
// Modify generated markdown to be conform with dev.to 
md = md
  // convert links to liquid tags https://forem.dev/p/editor_guide
  .replaceAll(/https:\/\/twitter\.com\/.+\/status\/(\d+)[?]?.*/gmi, "{% twitter $1 %}" )
  .replaceAll(/https:\/\/stackoverflow\.com\/questions\/(\d+)\/.*[?]?.*/gmi, "{% stackoverflow $1 %}")
  .replaceAll(/https:\/\/stackoverflow\.com\/a\/(\d+)\/.*[?]?.*/gmi, "{% stackoverflow $1 %}")
  .replaceAll(/https:\/\/(.*).stackexchange\.com\/questions\/(\d+)\/.*[?]?.*/gmi, "{% stackexchange $2 $1 %}")
  .replaceAll(/(https:\/\/[\w\.]+wikipedia.org\/wiki\/[\w]+)/gmi, "{% wikipedia $1 %}")
  .replaceAll(/https:\/\/github.com\/([\w-]+\/[\w-]+)\/?/gmi, "{% github $1 %}")
  .replaceAll(/(https:\/\/github.com\/[\w-]+\/[\w-]+\/issues\/\d+)/gmi, "{% github $1 %}")
  .replaceAll(/https:\/\/glitch.com\/edit\/#!\/([\w-]+)[?]?(?:path=)?([\w.]+)?/gmi, "{% glitch $1 file=$2 %}")
  .replaceAll(/https:\/\/glitch.com\/edit\/#!\/([\w-]+)/gmi, "{% glitch $1 %}")
  .replaceAll(/{{video: (.+)}}/gmi, (v, url) => {
    // Neat trick to get the id of youtube video
    const id = new URL(url).searchParams.get('v');
    return "{% youtube " + id + " %}";
  })
  .replaceAll(/\^\^(.*)\^\^\s/gmi, "<mark>$1</mark> ");
// Delete the text from markdown that is above the frontmatter marker
md = md.split('---');
md.splice(0, 1, ' ');
md = md.join('---').trim();

// Make a post request with the markdown to glitch reverse proxy server 
await fetch('https://roam-to-dev.glitch.me/', {
    method: 'POST',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify(
      {"markdown": md})
});

return "#published";```%>

📋 Describe the SmartBlock

SmartBlock to convert page content to markdown and format it to conform with dev.to article syntax and then publish it.

✅ Describe any prerequisites or dependencies that are required for this SmartBlock

You need two things: 1. a certain page structure, I have a simple SmartBlock that helps me create this structure

#42SmartBlock Nugget

#Nugget {{Publish:42smartblock:Publish Nugget}}

```
---
```
```
title: <%INPUT:title of the nugget%>
```
```
tags: nugget, <%INPUT:add max 3 tags%>
```
```
published: false
```

canonical_url: <%CONCAT:https,://,amin.pw/nugget/,<%INPUT:enter slug%>%>

```
cover_image:
```
```
---
```
```
<%CURSOR%>
```

dev.to does not allow to publish from the frontend due to CORS issues, you need to create a proxy server to the api. I personally use a simple node.js server in glitch.com you can copy from here https://glitch.com/edit/#!/roam-to-dev?path=server.js

📷 Screenshot of your #42SmartBlock workflow/template from Roam

💡 Additional Info

View on GitHub

And that is it, I now have a system that allows me to publish content from RoamResearch to dev.to. Thanks to RoamResearch for being so extensible, and also to the awesome community and especially RoamHacker for coming up with SmartBlocks (If you want to a deep dive into the internals of SmartBlocks, make sure to watch this awesome, and long 😅, video ;) )