It looks like we can create an external plugins directory according to this guide:
And then do something to add all of these external directories like it describes. This would make it so it's still easy to upgrade CKEditor and that the plugins are separate.
// get path of directory ckeditor
var basePath = CKEDITOR.basePath;
basePath = basePath.substr(0, basePath.indexOf("ckeditor/"));