It does? For some reason when I had the ir filter out it made things seem paler. Could have been a difference in lighting though...
Dont worry though, either way you can just put it back in and it will be the same as before. Also, while taking the ir filter out, you may just want to pry it out instead of cutting it...