Some people really overreact before they think through an idea properly. Give them hell. :)

Never give up your idea of house/building awesomeness!

...and, I have an article by Rosalind Krauss on 'Sculpture in the Expanded Field' that talks about the role of sculpture from monument to now that actually is relevant in an architectural sense (to me) ...if you're interested.