If Silas was really that clumsy, then others would simply accept that he had been careless once again.
If the pattern fit, then there was even less of a reason to doubt that kind of reasoning.
If the pattern happened to show how there could have been some other meaning behind what happened each time, then it could also subtly point out how his actions could have been intentional, and there could have been a motive behind it all.
Those smart enough to read between the lines would be able to decipher the hidden meaning in the words.
Cedric did not outright blame Silas, but he did bring attention to that pattern of accidents and how Ash or the person he knew as Elara, was never the one at fault in either of those situations.
She had been the very person who would have been endangered both times, and despite that, she had still chosen to try to save him.
