In the Alexa app, visit the hamburger-line More/Menu icon at the bottom to open the larger menu. The head to Settings > Hunches > the Hunches Settings gear icon in the upper right > Notifications.
Though its convenience definitely helps make life easier, it's possible that your Amazon Echo never stops listening, even when you haven't activated it.
How the Amazon Echo can hear you from across the room. Amazon has released Echo, a speaker that acts as a personal assistant, seen in this photo from Amazon's promotional video, "Introducing Amazon ...