How does Petey leave his team in remember the titans?

When he was taking heat from the coach, he walked away. Later on, he wanted to play and Yoast reminded him that he left his team high and dry when they needed him.