The house is built on three terrace lots, bought by the Chan family in 1861. Prior to its opening as a museum in 1985, the house was home to four generations. The name of the museum is derived from the term Baba, an honorific manner of addressing a Straits-born gentleman and Nyonya which addresses a Straits-born lady.
