So this has happened on both a development sub directory and on on a sub directory on a website.
We installed the appPhone quickstart in both cases and when we went to delete the entire Joomla installation after testing, it leaves directories behind that just will not delete. We've tried changing the permissions with no luck.
What is the cause and what is the fix?