I suspect Capitol Hill is just not where Trump voters live, so they did not have the opportunity to go there easily. Also he is not a great speaker and he is just another old white male president, no one assumed it would be an opportunity to attend to a historical event.