While the overlay is much better than it used to be, it isn't perfect. Here are two common scenarios:
Settings → Gaming → Xbox Game Bar → Enable Xbox Game Bar (toggle off) ms-gaming overlay windows 10
The overlay serves as a central hub for various gaming utilities: While the overlay is much better than it
Simply press Windows Key + G on your keyboard. ms-gaming overlay windows 10