GH-148874: Make sure that mngr.__exit__() is always called in a with statement

GH-148874: Make sure that mngr.__exit__() is always called in a with statement #199017