Unmapping the global mappings on a per-buffer basis