Newton's third law says that every action creates a force that is met by an equal reaction force from the opposite direction. The hard floor has more force than the volleyball, so the ball bounces off the floor to equalize the reaction of the impact.
