What happens if someone commits a crime and get arrested in a non-extradition country?

I remember the story of Edward Snowden and how he fled to Switzerland to avoid conviction in the United States and also Roman Polanski did the same thing. My question is what happens if an American gets arrested in another country? Do they get tried and serve time in that country?