Microsoft released exciting research on a method that can improve even existing LLMs, which they have called Layer-Selective Rank Reduction (LASER).

They are seeing 20-30% model improvements with reduced memory requirements.

It appears relatively easy (for the engineers) to implement, so I believe we’ll hear more about LASER as it’s applied in the real world.


Leave a Reply

Avatar placeholder

Your email address will not be published. Required fields are marked *