The Gujarat High Court Friday refused to stay the conviction and two-year jail term imposed on Congress leader Rahul Gandhi by a Magistrate court in a criminal defamation case for his remark "All thieves have Modi surname" [Rahul Gandhi v Purnesh Modi].