That’s a really cool idea actually. I never considered that you could use such a crazy low quant to, it sounds like, temporarily “train” it for the task at hand instead of having to use up countless watt hours training the model itself!
That’s how I use these things, too. Not to “help me code”, but as a fancy search engine that can generally nudge me towards a solution I can work out myself.
That’s a really cool idea actually. I never considered that you could use such a crazy low quant to, it sounds like, temporarily “train” it for the task at hand instead of having to use up countless watt hours training the model itself!
That’s how I use these things, too. Not to “help me code”, but as a fancy search engine that can generally nudge me towards a solution I can work out myself.