So after researching a little more I found my answer inside the plugin.json of the quickstart-plugin.
"staticDirs": {
"images": "./images"
},
Adding a staticDirs key inside the plugin.json like that adds the static dirs inside /assets/plugins/your-plugin-name/.
