Of course you're not crazy. :) Different people like and dislike different things. I notice those actions-as-dialog-tags bits, and they take me out of the story. They call my attention to the writing--in a bad and distracting way--because they don't make sense to me. I can't conceive of someone grinning or shrugging a line of dialogue. To me it seems physically impossible, so it doesn't work for me. Other people may not even notice.

Opinions are a dime a dozen. ;)