I wonder if this issue isn't the cause? I just noticed that the thread count on my process goes up, too. For example, I end up with 4 gigs of memory use and over 600 threads.
https://clearscript.codeplex.com/workitem/86
https://clearscript.codeplex.com/workitem/86