No, you can go to the marriage registration office in the place where either party's permanent residence is located.
According to Article 4 of the Marriage Registration Ordinance, when mainland residents get married, both men and women should go to the marriage registration office of one party's permanent residence to register their marriage. If a Chinese citizen marries a foreigner in the mainland of China, or a mainland resident marries a Hong Kong resident, a Macao resident, a Taiwan resident, or an overseas Chinese in the mainland of China, both men and women shall jointly go to the marriage registration office in the place where the mainland resident's permanent residence is located to register their marriage.
It can be seen that marriage registration does not necessarily have to go to the civil affairs bureau where the husband's household registration is located.
