"Germany and Sweden face common issues with migration and integration," the German leader said at a joint press conference following the pair's one-to-one meeting.
"We agree that people fleeing for their lives must be protected…[but] we need to get better distribution of refugees in Europe."
According to a recent report by human rights campaign group Amnesty International, 50,235 people have sought asylum in Sweden in the past three years, which currently takes in more refugees per capita than any other European country. The Swedish government has pledged 1,200 resettlement places.
Germany received 46,265 new Syrian asylum applications in the same period, and has promised 30,000 resettlement places. The remaining 26 EU countries have pledged just 5,105 resettlement places between them.
Chancellor Angela Merkel told reporters it was essential that the two nations exchanged positive experiences and promised "intensive cooperation" with the Swedish government on immigration and related issues.
Stefan Löfven said German-Swedish relations were "very good", describing Germany as a "close friend and strategic partner for Sweden".
"Germany is our largest trading partner. We have many Swedish artists in Berlin," he said.
The leaders also discussed the Ukraine crisis, Greece's financial problems and international security in the wake of the recent terror attacks in France and Denmark.
Describing the recent agreement to extend Greece's international bailout as a "starting point" for talks with the new left-led Greek government, Merkel said she was pleased that "in the last few days we managed to show we are all able to make compromises".
Sweden's Prime Minister dubbed Russian aggression in Ukraine "the gravest security situation since the Cold War" and said that Sweden backed "preparing new sanctions if needed" as well as helping to "support Ukraine economically".
"We can not win the diplomatic battle and then have Ukraine collapsing. Sweden would like to contribute what we can. It is also important for our Baltic neighbours to feel that support," he said.
The Swedish leader was also set to visit the Jewish Museum in Berlin as well as the start-up laboratory Factory Berlin on Wednesday afternoon and was scheduled to hold talks with Germany's Vice-Chancellor Sigmar Gabriel of the Social Democratic Party (SPD).