So after researching a little more I found my answer inside the plugin.json of the quickstart-plugin.
"staticDirs": { "images": "./images" },Adding a staticDirs key inside the plugin.json like that adds the static dirs inside /assets/plugins/your-plugin-name/.