No, the thing which was annoying me was basically an excessive use of the phrase 'that is to say'. It is in keeping with an old English butler, and he certainly uses it for effect, but it just rubbed me raw at times. Also, I've always thought a person should express what they mean on the first try without the codicil 'that is to say', which is meant to clarify. Kazuo knows this so I'm certain it is just unique to this character. You'll see what I mean when you read it.
And yes, I like to accept a book on its own terms as you describe. Ultimately, I like to critique it in a fair and balanced way.