The Content Technologist home The Content Technologist home
Search posts, tags and authors
  • Newsletter
  • About
  • Contact
  • Join
dc June 12, 2023 10 minutes read

Robots.txt vs. AI robots: How to block your web-based IP from crawlers

You can never truly own words, but you may have anxiety about feeding your web-based writing to the robots. While no content is entirely immune from plagiarism, options for reducing AI mimicry have their own pros and cons.

Tags: accountability, AI, big tech, chatbot, content strategy, data stories, ethics, media, metadata, natural language generation, privacy, security, web
One sculptural mannequin looks at a laptop while another holds a tablet.
Photo by Brett Jordan / Unsplash

This post is for subscribers only

Sign up now to read the post and get access to the full library of posts for subscribers only.

Sign up now Already have an account? Sign in
Newer post

A UX mind-shift for website publishing: Consider reader experience

Older post

Keep brands weird: The research framework for exceptional data-driven content

Newsletter

By signing up, I agree to receive emails from The Content Technologist.

Processing your application... Please check your inbox and click the link to confirm your subscription. There was an error sending the email
The Content Technologist home The Content Technologist home

A resource for content professionals working in the age of algorithms

  • Links

    • Start here
    • Contact
    • Affiliate partnerships
    • Content design
    • Content strategy
    • Information architecture
    • SEO
    • UX
    • Terms and conditions
    • Cookie policy
© 2025 The Content Technologist. Published with Ghost and Myoan.