These watermarks require the text to be long-ish and not too edited from the original. I didn’t see this explained in the article, but I only skimmed it. The press release from Anthropic goes into it, without giving many details.
I’m guessing it’s going to embed a pattern with punctuation and word/letter choices, so there will need to be a sufficient amount of text to ensure its actually the watermark and not just dumb luck.
Yeah it’s exactly a pattern with token choices, by introducing a statistical bias to the randomness in token generation. Quality isn’t affected because the model is still choosing from the best candidates for the next token. You’re right that to be effective they need a long enough input to get enough matches to be.
Computer code is also going to be less effective because code has a much more rigid structure dictated by language syntax rules, coding conventions, linters and formatters, etc.
These watermarks require the text to be long-ish and not too edited from the original. I didn’t see this explained in the article, but I only skimmed it. The press release from Anthropic goes into it, without giving many details.
I’m guessing it’s going to embed a pattern with punctuation and word/letter choices, so there will need to be a sufficient amount of text to ensure its actually the watermark and not just dumb luck.
Yeah it’s exactly a pattern with token choices, by introducing a statistical bias to the randomness in token generation. Quality isn’t affected because the model is still choosing from the best candidates for the next token. You’re right that to be effective they need a long enough input to get enough matches to be.
Computer code is also going to be less effective because code has a much more rigid structure dictated by language syntax rules, coding conventions, linters and formatters, etc.