This is what remains of the memorial to Ramarley Graham. (You can see a close-up here.)
This odd little structure is nestled beneath the White Plains Road Line's Gun Hill Road station (which also once served as the northern terminus of the old Third Avenue El).
UPDATE: I've learned more about this building.