Explanation

The correct verb-preposition combination is "belong to", which means to be the property of someone.

The sentence is about ownership, so we use "to".

The books belong to me.