If you have preloadedBarTender into memory, you can tell it to exit using the following command line:
bartend.exe /X
In the above command line, the /X parameter is used, which instructs the currently running copy of BarTender to exit without saving any changes to the active document.