• skankhunt42@lemmy.ca
    link
    fedilink
    English
    arrow-up
    30
    ·
    1 year ago

    Unfortunately, we are penalized by the modern Internet for leaving all previously published content live on our site

    Even if this is true, which I doubt, why not edit your robots.txt to disallow them to index it and leave the content up?

    • Puzzle_Sluts_4Ever@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      3
      ·
      1 year ago

      Because then they are hosting content that actively won’t show up in any search?

      Hosting web content (especially with lots of images) costs money. Historically, sites like cnet were built around ad revenue. It is worth keeping a review of a 2001 GE Refrigerator online if it comes up when people search for the model number (generally to figure out specs to shop for a replacement). It is not worth it if that is showing up when people want to buy a 2023 GE Refrigerator or actively penalizes you for having too much “old” content and so forth.

      And if it won’t generate any ad revenue going forward? baleeted!