In 1844-1847 the brick customs building built in Tauragė is now called Tauragė Castle. The whole architectural ensemble of the castle has romantic features of the Renaissance castle style. In 1844 a staged project of the customs building was made. In 1847 a two-story brick building for border detainees was built. In 1852 the building was fenced with a masonry fence, a sauna is built in the yard, farm buildings, a well is dug. The whole ensemble is rebuilt into the castle prison, corner towers and shooting openings appear during the reconstruction. The whole architectural ensemble is given the "romantic" character of a Renaissance castle. At that time, the castle acquires the general image and layout that has survived to this day. Only after the war, in 1971 and in 1986 two new buildings were built in the courtyard of the castle.