Palazzo Rimondi is partially hosted within a building which dates back to the Venetian occupation of Crete (1200 – 1600 AD) and bearing obvious influences from the Renaissance.

There followed a series of phases of elaborate construction in the form of building additions during the Turkish occupation, as well as, during the 19th and 20th century.