Is going from a civil engineering undergrad into grad school in architectural engineering a legitimate path?

I will be graduating with a civil and environmental engineering undergraduate in the next 2 years and have begun thinking about graduate school. I have considered structural engineering and am currently interning for a structural engineering firm, but would like to explore the idea of studying architectural engineering. Is this a path that is taken, or would I be at any sort of disadvantage?