She pretty much went all over the city when she went there in 2005, the magazine you're thinking of must be ViVi January 2006.
Link.
In that she went to 5th avenue, Times Square, Flatiron district, Union Square and The Village and SoHo area with Bleecker St. and the Magnolia Bakery (Bleecker and 11th). The red balloon picture actually wasn't taken on Bleecker but on Perry Street, at 78 like you can see on the picture. It's one block down from the Magnolia Bakery, in between Bleecker and 4th street. I noticed this one day when I was walking on 4th and looked down Perry, I was like "wait a minute.."
This isn't where Carrie's apartment exterior was filmed though, that was all the way up on east 72nd street on the Upper East Side.
For the 2 PVs she shot there, Pride was filmed under the overpass of Riverside Drive on 12th Ave, starting at 135th street. Bold and Delicious is pretty much all over the place, all the way from up in Harlem, down on Lexington and Park ave.
From the (miss)understood booklet you can see she went to Central Park and walked around with her dogs too, she did stay right on 59th street with a view of it. She went to the Bow Bridge, a really famous bridge right by Bethesda Terrace and the fountain.