You shouldn't really be getting FPS drops with a PC like that, only thing that I can suggest of that is the graphics card, seems abit outdated compared to your processor, I currently have a GTX 1050 4GB with a i5 processor and have no issues.
Ensure that you don't have your games stored on your SSD also, with it being quiet small that might impact it, other than that not sure dude