I'm having the same problem and need to "reset" the MEF container and clear out the shared parts.
This is a dealbreaker for using MEF for IoC if I cannot empty out the container.
As Dimpu575 stated, ReleaseExports only works on non-shared instances.
Jaans
PS: @Dimpu575 - Did you find a way to solve this issue yet?