I'm not super experienced with horror, but Kings Game was very scary. Think about an anime where you really love and want to see the characters develop their relationships, and then make then play SAW to save each other.
Kings Game, terrifying. I wouldn't watch it if your under 21 though, it's pretty intense.