Synonyms for Troglodyte (same or very similar meaning)
WordNet sense 1 (one who lives in solitude):
hermit, recluse, solitary, solitudinarian
WordNet sense 2 (someone who lives in a cave):
caveman, cave dweller
From the ODE community, based on WordNet
add/edit