Watching a seminar on RISC-V and LLM optimizations being done by SiFive.   15 mins in they are talking about assembler and vector math.

They don't screw around. 

Learned about a new compiler thing, converts pytorch stuff to some other closer to metal runtime ( and in theory bare metal ).   Great, more stuff to learn .. lol 

Far more came from GitHub actually since there was zero paywall there,. So actual ( mostly ) functioning code. But yes, some from Stack O and some from Reddit, and Medium, and other places, and manuals, and 3rd party books ( big stink on that one.. due to the source of the books )  But really its more than the simple sum of its parts. Just like people.  That is how transformers work. Just like how we operate. Only real difference is real-time feedback to change the model on the fly, like humans have.

And no, they are not perfect ( just like people ), but they can save a lot of time if used with the correct expectations.  Suggestion: Yes i know i'm a big supporter of AI for decades ( long before transformers came onto the scene, which is what most are built on now ) , but instead of being so negative towards the idea, you should it sometime and get some first hand experience, might find its helpful. If you try one of the big free commercial ones, do keep in mind they are not 'tailored' for coding and its just one piece of 'general use' training, so wont be as good as a locally run model that is tailored for coding will be.

Resource needs aside,  they are brain dead easy to run locally these days.  But perhaps if we coordinated the time i could open mine up for a bit to the outside if you wanted. Could try different models and such.  I dont have a lot of horsepower, so really cant run 2 people at once, and large models are slow, but that does not effect accuracy, just response time.  

Sun Oct 20 2024 18:17:32 EDT from IGnatius T Foobar

"this AI coding stuff is stupid"

It's just cribbing from Stack Overflow, which is what everyone was already doing anyway.

Oh, and you know i was not trying to be insulting..  i just see sooo much opportunity in this stuff i hate for people to miss it.   Got nothing to lose by trying, Zoe wont eat you.

As we all know by now, my wording is not always the best and often sounds harsher than meant. that silly lack of emotion thing creeps in.. 

Ok, ill give you that one.  Marketing ( for anything really ) is awful these days.  But i think its in part due to the general public's attention span being that of a flea.  If its not 'rah rah look at me' every 10 seconds, the public moves on to the next video....

( but, the offer still stands, if you want to experiment ;) )

Tue Oct 22 2024 09:25:47 EDT from IGnatius T Foobar

It isn't the technology that is detestable, it is the hype cycle.