Do Hot Neighborhoods Affect Everyone Equally?