The ruling in Brown was based on the 14th Amendment and its Equal Protection Clause. This does not apply to the Federal Government or to the District of Columbia which could still operate segregated schools. The issue regarding that was settled in the case of Bolling v. Sharpe 347 U.S. 497 (1954)*
See also: Landmark Case
* Click here to understand what those numbers mean