The Ghosh family came to Pathuriaghata at the time of Warren Hastings. It is said that Warren Hastings and his wife visited the Ghosh family.[10] Khelat Chandra Ghosh (1829-1878), grandson of Hasting’s banyan (clerk) Ramlochan Ghosh, shifted out of the old family house at 46 Pathuriaghata Street to a new house at 47 Pathuriaghata Street. The family made substantial contribution in music and charity. There is a lane named after him in Ward No. 24 (not shown in the map alongside). The lineage at 47 Pathuriaghata Street was Babu Khelat Ghosh, Babu Romanath Ghosh, Babu Siddheswar Ghosh (who patronized the famous Author Bibhuti Bhushan Bandopadhyay) and his brother Babu Aukhoy Ghosh. Presently the All Bengal Music Conference is held at 47 Pathuriaghata Street and is patronized by Babu Pradeep Ghosh [11] This mansion is filled with marble sculptures, paintings, crystal chandeliers and other art objects. In the year 1849, Raycharan Ghosh (zamindar) moved out of Kolkata and thus another family tree of the Ghosh family found lineage. His son Upendranath Ghosh was the Attorney General for the Awadh district under the British India Empire. Upendranath's first son Lalit Kumar Ghosh unified the families back and constructed a mansion near Rashbehari Avenue in Kolkata and wanted to keep one of the oldest Durga Puja traditions in Kolkata alive by entrusting the sons of the family with the responsibility.
In the halls of the Ghosh family at 46 Pathuriaghata Street, the All Bengal Music Conference was founded in 1937. Indian classical music was then a nascent art form; only baijis (courtesans) sang publicly. Manmathanath Ghosh (1908 – 1983) was the first patron to invite Hirabai Barodekar, a legendary musician, to the inner wing of his home, despite the protests of his wife. He considered it his honour to host talent, and the legendary sitar maestro Ravi Shankar met his guru Allauddin Khan there. The Durga Puja and its traditions continue to be followed by the current members of the family.