The Central Office is the building where all the telephones wires in your neighborhood are run. These building were first built way back when the first telephone wires were installed. Inside each Central Office is all the equipment needed to provide DSL service to people connected to it.
Here is a map showing the location of many COs in the Bay Area.
Here is a picture of the main Berkeley Central Office, on Bancroft just above Shattuck.