• 0 Posts
  • 39 Comments
Joined 7 months ago
cake
Cake day: December 16th, 2023

help-circle



  • I suppose the importance of the openness of the training data depends on your view of what a model is doing.

    If you feel like a model is more like a media file that the model loaders are playing back, where the prompt is more of a type of control over how you access this model then yes I suppose from a trustworthiness aspect there’s not much to the model’s training corpus being open

    I see models more in terms of how any other text encoder or serializer would work, if you were, say, manually encoding text. While there is a very low chance of any “malicious code” being executed, the importance is in the fact that you can check the expectations about how your inputs are being encoded against what the provider is telling you.

    As an example attack vector, much like with something like a malicious replacement technique for anything, if I were to download a pre-trained model from what I thought was a reputable source, but was man-in-the middled and provided with a maliciously trained model, suddenly the system I was relying on that uses that model is compromised in terms of the expected text output. Obviously that exact problem could be fixed with some has checking but I hope you see that in some cases even that wouldn’t be enough. (Such as malicious “official” providence)

    As these models become more prevalent, being able to guarantee integrity will become more and more of an issue.














  • There’s a weird implicit conservancy in tech circles around the dictatorial nature of corporate leadership.

    It stems from this weird externalization of corporate decision making that just turns everything that happens at large companies into the machinations of the unknowable machine of capital.

    “Of course they were fired, they protested in a way that disrupted the business, if the business is disrupted the machine must correct itself, and it did so by releasing the corporate anti-bodies of leadership to fire the disruptive element. Thus the machine is corrected. This is all logically sound, and thus impervious to moral inquisition.”




  • It’s cause Epic/McKesson has complete control over the EMR world so everything has to work with them to some degree.

    GNU health is great but I haven’t seen where it could support the massive amount of legal and monetary hoops that Epic and co have to jump through as well.

    For some reason there just isn’t a lot of volunteer efforts/space for open source development in the healthcare world.