'We too have been regretting': Betel leaf growers face difficulties