Synonyms for Fly-by-night (same or very similar meaning)
WordNet sense 1 (of businesses and businessmen of questionable honesty):
shady
WordNet sense 2 (not worthy of trust or belief):
untrustworthy, untrusty
WordNet sense 3 (not permanent; not lasting):
impermanent, temporary
From the ODE community, based on WordNet
add/edit