Now everything works as intended. When you open your PM box (the envelope), unread notifications such as mentions, post replies, comment replies and modmail will not get automatically marked as read (so you don't lose track of what you haven't read yet). The notification count will decrease only when you'll use "mark as read" or open a message link (or mark all as read). Thanks to @COFfer for the report, appreciated!