Some libraries can not be removed from attachments through hook_page_attachments_alter.