So after researching a little more I found my answer inside the plugin.json of the quickstart-plugin.

"staticDirs": {
	"images": "./images" 
},

Adding a staticDirs key inside the plugin.json like that adds the static dirs inside /assets/plugins/your-plugin-name/.