Woodsmen and railroaders made up the sparse population of the Embarrass area until the late 1800s, when Finnish immigrants established a permanent community. Embarrass Township was incorporated in 1905, and Finnish settlers began building homes, schools, and churches. Built in 1906 on donated land, the Apostolic Lutheran Church is the oldest existing church in Embarrass, with a simple and restrained Gothic design characteristic of many Lutheran churches in rural Minnesota. Before it was constructed, members held services in their homes for several years, led in the early years by local preachers including John Pylkka and Isaac Lamppa, Sr. Because the church was not affiliated with an official American synod, sacraments were sanctioned in Finland. Four years after the church was built, the first wedding, a double ceremony, took place there on March 27, 1910, when Matt and Eva Norha and Gregorius and Maria Hanka spoke their vows before the Reverend John Pollari. The 1925–26 confirmation class included confirmed members from Apostolic Lutheran congregations throughout northeastern Minnesota who boarded with Embarrass families while preparing for the sacrament. Services are still held there on special occasions, and its board meets annually.