You can have a config.yml file that loads directly from your jar file. It must be added to your project's folder, the same way as the plugin.yml file is.
In this file you have the default values for your configuration.
Example config:
# This is an YML comment
adminName: "Kerooker"
mod...