Jeffrey Fowle, an American arrested in North Korea in May for leaving a bible at a club for foreign sailors, has been released and is on his way home, a senior State Department official told CNN on Tuesday.

An American government plane picked up Fowle on Tuesday before flying to Guam, the official said.

North Korea announced Fowle's detention in June, saying he had violated the law by acting "contrary to the purpose of tourism."

Although North Korea contains a number of state-controlled churches, the totalitarian regime forbids independent religious activities, viewing them as potential threats to its authority.

CNN learned of Fowle's release earlier Tuesday but agreed not to report the news until he landed in Guam.

White House Press Secretary Josh Earnest confirmed Fowle's release on Tuesday, saying the Defense Department had arranged his transportation out of the country at the North Korean government's request.

"We certainly welcome the decision," Earnest said, adding that the United States has no updates on the status of two other Americans imprisoned in North Korea -- Matthew Miller and Kenneth Bae -- and calling on North Korea to "immediately release them."

State Department spokeswoman Marie Harf echoed Earnest's call, saying the U.S. government "will continue to work actively on their cases."

She praised the "tireless efforts" of the Swedish embassy in Pyongyang, which houses the United States' representation within North Korea since the U.S. government doesn't have an embassy in the country.

Sen. Rob Portman said he's pleased Fowle "is returning home to his family and can close the chapter on a horrific ordeal in North Korea."

The Ohio Republican said he spoke with Fowle's wife and Robert King, the U.S. special envoy on North Korean human rights issues, after Fowle -- a Miamisburg, Ohio resident -- was detained. He said he worked with the State Department and "many other entities to bring him home."

"North Korea is a country with egregious human rights violations and it's important that the U.S. continue to stand for the rights of all people, including religious freedoms, at home and abroad," Portman said. "My prayers are with Mr. Fowle and his family as he makes the transition home."

Last month, Fowle gave an interview to CNN pleading for U.S. help and speaking about conditions of his detention.

He spoke to CNN with Bae and Miller.

In the interview, Fowle said he has "no complaints" about his treatment.

"It's been very good so far, and I hope and pray that it continues, while I'm here two more days or two more decades," he said.

North Korean officials monitored and recorded the interviews and CNN was unable to assess independently the conditions under which the men were being held.

"It's a covert act and a violation of tourists' rules. I've admitted my guilt to the government and signed a statement to that effect and requested forgiveness from the people and the government of the DPRK," Fowle said.

Fowle said at the time he expected his trial to start within a month.

Bae, a Korean-American missionary, was sentenced to 15 years hard labor in 2013. He told CNN he was working eight hours a day, six days a week at a labor camp, but was being treated "as humanely as possible."

Miller was accused of tearing up his tourist visa and seeking asylum upon entry. He told CNN his situation was "very urgent" and would soon be sent to trial and "directly be sent to prison."

All three implored the U.S. government to send an envoy to North Korea to help get them out of their situations, similar to how former President Bill Clinton helped secure the release of two journalists in 2009.

However it did not appear such an envoy was sent to negotiate Fowle's release.

The senior State Department official said the U.S. was still working to secure the release of Bae and Miller.

(CNN)