OK, I just tried this in IE8, and it definitely looks buggy to me.
I created a new message with some text, and placed the cursor in a random spot, highlighted here:
http://imageshack.us/photo/my-images/109/smileybugbefore.jpgI added a smiley, and it added it to what appeared to be a random spot in the text. It also moved the cursor to the end of the message:
http://imageshack.us/photo/my-images/121/smileybugafter1.jpgI moved the cursor to another random spot, highlighted here:
http://imageshack.us/photo/my-images/34/smileybugbefore2.jpg/I added another smiley, and it put it right after the previous one:
http://imageshack.us/photo/my-images/638/smileybugafter2.jpg/The fact that it went back to the same spot makes me believe it's not random at all. I think there's a fixable and re-creatable reason it's putting that smiley there.
Interestingly, I tried the same thing with forum posts, since I figured it would be the same javascript, and in limited testing it looks like no matter where the cursor is, the smiley gets added to the end of the message. Still buggy, but in a different way.
Likely a bug.