In conjunction with the decision, the company has also decided to dispense with its 3G license in the country.
The administration of Tele2's existing Finnish customers will be transferred to Sweden.
"Given the current market environment, we see better opportunities elsewhere," chief executive Lars-Johan Jarnheimer said in a statement.
Jarnheimer said Tele2 was for example not able to sell local calls in Finland.
Tele2 began its operations in Finland in 2000.