Sean Anderson, one of the occupiers who remains, told CNN he is there with his wife and two others.
There had been five people still in the refuge, but one man left Thursday morning. One of the others inside the refuge drove the man to a checkpoint and dropped him off, Anderson said.
The four have a proposal to leave peacefully but are not afraid to die, Anderson said.
They want the FBI to let them walk away and return to their home states without being arrested or confronted, Anderson said.
"We are willing to leave peacefully," he said. "If the FBI will let us leave without arrest or forcing us through the checkpoint, we will all go home."