Residents say moving Richmond Library will makes access harder for older and disabled users.