Only white people were allowed to live there, though an exception was made for servants.

Bush's New Neighborhood Barred Non-Whites Until 2000

New Bush Neighbor In Dallas: I'm Afraid "The Whole Neighborhood Is Going To Be A Target"

The impending presence of a former President is ratcheting up security fears. "I am afraid with all the negative press the president has been getting, the whole neighborhood is going to be a target," said a woman, who wouldn't give her name.

Raw Story reports that the area had some issues long before Bush made it his new home.
Until 2000, the neighborhood association's covenant said only white people were allowed to live there, though an exception was made for servants. The document, enacted in 1956, reads:
"Said property shall be used and occupied by white persons only except these covenants shall not prevent occupancy by domestic servants of different race or nationality in the employ of a tenant."