Synonyms for Contrarily (same or very similar meaning)
WordNet sense 1 (in a contrary disobedient manner):
contrariwise, perverselyWordNet sense 2 (contrary to expectations):
on the contrary, to the contraryFrom the ODE community, based on WordNetadd/edit