Fortifications were first built on this strategic point at the mouth of the River
Vistula in the time of the Teutonic Knights. Work on the construction of a brick
tower began in 1482. From here, a duty was levied on passing ships using a
simple enforcement method that was impossible to avoid – a chain was stretched
across the river, preventing the ship’s passage, and released only when the
captain had made the required payment. Equipped with a brazier in which a fire
was lit, the tower was also used as a lighthouse.

In 1562–3 the tower was surrounded by a system of defences, and afterwards was
repeatedly fortified and refortified as military technology advanced. In 1586–7
the entire complex was reinforced by four bastions, designed by Antonis van
Opbergen and Jan Strakowski, and an outer moat was added. This was followed by
the addition of a ditch in 1624–6. Also in the 17th century, 15 tall barrack
buildings were added around the now-ageing tower.

Over the following years, constant building, often by prominent fortification
engineers of the time, steadily enlarged the fortress. It withstood several
sieges and was often used to accommodate visiting royalty.