By the time he arrives, we _____ already left.

Will have been

Had

Have

Will have

By the time he arrives, we will have already left.

This uses the future perfect tense to indicate that an action will be completed before another future event.