After incredibly frustrating errors with ChatGPT, I switched to try Anthropic's Claude for help drafting and refining documents. Just like ChatGPT, you do not have access to "Projects" -- which collects threads and files into a common database for reference -- without a subscription.
And of course I have screenshots (see bottom of slides).
However, despite fewer sudden gross procedural errors than ChatGPT, a Pro subscription to Claude might be worse:
- (slides 1-3) It frequently retrieves data incorrectly from the Project files.
- Despite being way under file limits (around 12% currently) and telling it exactly which files to look at and for what, it can still collect data that is factually incorrect.
- Then proceeds to use it in the document draft in Canvas.
- Now I have to luckily spot these gross factual errors and
- Explain it to Claude.
- Get it to re-read data.
- And then fix the draft.
- (slides 4-6) Even when it does this, there might still be a version mismatch error that also requires correction.
- What frequently happens is Claude claims it has made certain changes.
- You even see it editing the draft document in the canvas.
- But all changes are reverted in canvas draft -- the version number may have changed, but nothing has actually been edited. If you don't realize this, you could continue to work on an outdated draft.
- Meanwhile Claude thinks it has successfully applied edits because it got confirmation it did, AND it has a different "internal" view of the draft.
- You have to realize it has this internal and different version, then get it to dump it into a new canvas version to see what it sees and see the changes it thinks it applied.
- Chasing and fixing all these errors costs you prompts, and even on a Pro subscription, you have sharply LIMITED usage. So literally you are:
- Paying to test a bugged product.
- Paying to submit bug reports.
- Wasting your limited prompts fixing errors.
- Getting locked out of doing actual work when you hit the limit, which resets literally HOURS later.
What the heck are you really paying for?
They should be paying YOU.
Is the subscription actually a scam?
Comments
Post a Comment