Bees or wasps in wall?

I live in a wooden house and my room is on the second floor. During the day I can hear a crackling and buzzing noise. I presume it is bees or wasps of some kind due to research, but I'm not entirely sure what to do about it. So far they have not entered my room, but I can't see where they exit and enter as the house is covered in ivy and, like I said, I'm on the second floor. Will they leave in winter? Do they return to the same hive? Should I even get rid of them?