To close some instance, you need to have it open first.
If I got it right, you need to close excel that was opened by the app - then you need to attach to it first (by workbook name if there are more than once instance running), then close instance will work.