Does a "canard configuration" refer only to the horizontal surface, i.e. can there be a vertical fin at the rear of the glider?

Yes, a vertical fin may be at the rear of the glider for a canard as long as it does not provide any lift.