Learned that you can use the atom editor to view markdown. Download atom from here.

Once installed, open up the markdown file via atom file.md. In the menu at the top you select Packages → Markdown Preview → Toggle Preview (or use the shortcut ⌃⇧M).