Removing report filter in reading view

I added a Report Filter. When a user goes into Reading View on that report, The filter itself worked fine.
However, in Reading View, I was able to click the "X" in the upper right of the Filter and it removed the filter from the report. When I refresh the page, the filters returns. 

I was wondering if I can turn this option off? 

thanks.