There are a few delicate little mushrooms that commonly sprout from the soil of nursery grown plants. The yellow species pictured below appears to be the most common of them.
Mature mushrooms range from pale to bright yellow and stand about 4 inches tall. I’ll forego the detailed description here… If you see little yellow mushrooms growing from your potted plants it’s pretty safe to assume that this is your guy. They are tissue-paper delicate and don’t normally last more than a day or two before shriveling away. So try to enjoy the short lived novelty of this harmless mushroom if you ever see them among your houseplants.