could this cause a knocking noise?
I would try to determine why it 'fell' off but put it back on idle for 30 seconds if noise gone then you won't have to pull pan....
You MIGHT have dodged a major bullet. Move slowly as posted determine why it came off, and fix what caused it to come off so it is not repeated.
Good luck



