Antonyms for On Purpose (opposite meaning)
WordNet sense 1 (without intention; in an unintentional manner):
accidentally, unintentionally
WordNet sense 2 (without advance planning):
circumstantially, unexpectedly, by chance
From the ODE community, based on WordNet
add/edit