I went last September and had a great time. Get the ferry from the financial district over to Brooklyn. Great views and inexpensive. You can then check out Brooklyn and get the ferry back to Midtown. If you want a good steak then Gallaghers is unreal. Typically I would avoid areas like Times Square and check out Greenwich and Chelsea as they are much nicer.
Walk the high line and then if you are feeling it you can continue to walk by the Hudson all the way to ground zero.
If you like ice cream then Cafe Panna is a must visit.