Try setting the Remaining length option to [Custom] when removing silence.
Remove silence longer than: Increasing this value prevents short silences from being removed. (Threshold for silence removal)
Padding before sentence: A higher value keeps more silence before each sentence. (Preserve silence before sentence)
Padding after sentence: A higher value keeps more silence after each sentence.
Adjust this if the end of a sentence is being cut off unintentionally. (Preserve silence after sentence)
If you remove silence using the [Auto Rough Cut] menu, you can fine-tune the cut sections in the timeline panel.