Suggestion for one line:
“The *dt* argument must be aware with ``tzinfo`` set to ``self``.”
“The *dt* argument must be an aware datetime, with ``tzinfo`` set to ``self``.”

If there is a reST construct for aware datetime, use it. Since “self” is not special, perhaps an alternate wording like “the timezone instance from which the method is called”, but less ugly.

Some PyDoc_STR calls still use “Returns.”

By the way, you could have committed the unittest changes directly.