Synonyms for Cautiously (same or very similar meaning)
WordNet sense 1 (in a conservative manner):
conservatively, guardedly
WordNet sense 2 (with caution or prudence or tact):
carefully, with kid gloves
From the ODE community, based on WordNet
add/edit