 When Ghosh was young, his father S.M Ghosh left the family and married another woman leaving the family to Asnat, which she raised all by herself in Wari, Old Dhaka.His brother, Ashok Ghosh, was a film director in Bangladesh and directed the film Nacher Putol 1972, which has the famous song “”Rup Nogorer Rajkonna.When the Second World War ended in 1945, the six-year-old Ghosh along with his family moved to Dhaka, in Bengal (in pre-partitioned India).