JMS connections survive undeployment

I am using JMS endpoints in a camel-servletlistener based application.
In order to get better performance I use the Spring CachingConnectionFactory
on my endpoints.
An effect of this is that when I undeploy my application the active (cached)
connections do not get destroyed (the seem to survive until I restart my
application server).

I am looking for options on how to remedy this situation.

Thanks

Lars