I have had the Note 5 for about a week and Im loving it so far. Its fast, efficient, the display is absolutely gorgeous, and it seems to sip battery compared to previous phones Ive had(last was Nexus 5, so no SD and no removable battery was already something I lived with). Im not too worried about the pen problems myself, and I find the new pen very useful and intuitive. Also, as everyone agrees, the camera is awesome- Im more encouraged to take photos and videos just because its so easy to use and fast.
The fast charging is the other great feature. you can charge the phone from 0 to 100 percent in maybe an hour and 20 mins at most, most charge times in reality are an hour or less, unless you really drain the battery. I picked up a Qualcomm 2.0 quick charger for my car(12v plugin) and a 15, 000 maH Quick Charge 2.0 battery pack just to satisfy the need to have juice on hand, though the Note doesnt really need it in normal usage.
Oh yeah, and the built in wireless charging is great- I got a free Samsung wireless charger with a promo and I have it on the night stand, throw my phone there, no cable fishing, and its 100 percent every morning. Once released, the phone also supports fast wireless charging- but in my case, it doesnt really matter and I think wireless charging at night is awesome. TouchWiz is much improved from when I last dealt with it(Galaxy S2), but I still prefer the simplicity and utility of Google Now launcher, so I run that as my daily driver. I enabled the animation tweaks(sped them up with developer options) and the phone is incredibly snappy and fluid using the launcher.