Yeah, there is no way of knowing. Even if they have luggage, that is no guarantee they are going to the airport or train station. They could be going to work 1 mile away in downtown, and they are travelling later in the day.
Also, I have called the pax ahead to find out if I have something going on or am ready to go home.