Synonyms for Illegitimately (same or very similar meaning)
WordNet sense 1 (in a manner disapproved or not allowed by custom):
illicitlyWordNet sense 2 (of biological parents not married to each other):
out of wedlockFrom the ODE community, based on WordNetadd/edit