The decision has been more than 20 years in the making, Ullenhag said, and has been discussed extensively on both parliamentary and international levels.
"I think we should have done it before," Ullenhag told The Local. "But at least we're doing it now."
The suggestion received unanimous support from the governing alliance of Sweden. On Thursday an investigation was launched into how best to implement the decision.
Follow Solveig on Twitter