Senior BJP leader and former Uttar Pradesh chief minister Kalyan Singh on Monday accused the then Congress government at the Centre of levelling "false and baseless allegations" against him in the Babri mosque demolition case and said he was "innocent".