• 0 Posts
  • 12 Comments
Joined 1 year ago
cake
Cake day: June 11th, 2023

help-circle

  • IDe@lemmy.onetoGo - Weiqi - Baduk@lemmy.mlHow do you use AI to train?
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    11 months ago

    One thing AI has taught me is that it’s not really about the specific move (unless it’s life and death), but about direction. Almost always playing roughly in the correct direction results in +/- 2 point changes at best, whereas wrong direction, even if it’s locally good can easily cost you 5-10 points. It really helped me stop fussing over the “correct sequence”/joseki/fuseki and focus on mistakes that were actually costing me the games.

    For training my intuition I find replaying/memorizing pro games is still far more effective, since the moves follow human reasoning and shapes. AI seems to work best as a review tool for finding/exploring mistakes.


  • This sentiment always pops up when the topic is discussed, but it doesn’t really make any sense.
    Any sort of setup depends on the government not being co-opted or corrupted.
    Free speech absolutism does nothing to prevent a corrupt government from censoring you.
    You can’t really use that as an argument for free speech absolutism when it suffers from the exact same issue.










  • Most of the data used in training GPT4 has been gathered through open initiatives like Wikipedia and CommonCrawl. Both are freely accessible by anyone. As for building datasets and models, there are many non-profits like LAION and EleutherAI involved that release their models for free for others to iterate on.

    While actually running the larger models at a reasonable scale will always require expensive computational resources, you really only need to do the expensive base model training once. So the cost is not nearly as expensive as one might first think.

    Any headstart OpenAI may have gotten is quickly diminishing, and it’s not like they actually have any super secret sauce behind the scenes. The situation is nowhere as bleak as you make it sound.

    Fighting against the use of publicly accessible data is ultimately as self-sabotaging ludditism as fighting against encryption.