I would say: "I left my purse on the bus, but I got it back."
We usually don't say we lost something if we know where it is. That's even if in the case of it being on the bus we don't really know where it is.
If you want to say more, try: "I left my purse on the bus, but fortunately I got it back. I went from being sad to glad."
Also possible: "I left my purse on the bus, and it took the whole afternoon to get it back."