The palace, situated in today's Piazza Rey in Vinovo, was built between 1480 and 1517 to replace a smaller palace used as defensive fortress. According to some scholars, the current, more modern and rational building was designed by architect Baccio Pontelli; others maintain that the architect was Meo Del Caprino.