Tiny Core Linux

Off-Topic => Off-Topic - The Funnies => Topic started by: mocore on February 25, 2024, 06:45:22 AM

Title: AVX2 is dimwitted compared to AVX512
Post by: mocore on February 25, 2024, 06:45:22 AM

*puts ML hat on*  ::)

older gpu/hw fails to solve mathematical riddles ...

https://github.com/google/gemma.cpp/issues/23

Quote

On a $10,000 AMD Ryzen 7995WX (znver4 avx512) Gemma 7b instruct sfp is able to solve mathematical riddles.

 :P
(https://i.imgur.com/C92m98b.png)

Title: Re: AVX2 is dimwitted compared to AVX512
Post by: Rich on February 25, 2024, 10:00:51 AM

Hi mocore

Quote from: mocore on February 25, 2024, 06:45:22 AM

... older gpu/hw fails to solve mathematical riddles ...

https://github.com/google/gemma.cpp/issues/23 ...

I'll admit a lot of the stuff they were talking about was over my head, but
to me it appeared the second machine was treating this as a linear problem
instead of an exponential one.

Exponential (volume doubles each day):
Algae growth rate = StartQuantity * ( 2 ^ Days )
Days to fill reservoir = 30
Days to fill half reservoir = 29

Linear (volume increases by equal amount each day):
Algae growth rate = StartQuantity * Days
Days to fill reservoir = 30
Days to fill half reservoir = 15

Of course it still could have been a subtle math error and the fact
that it answered 15 was just a coincidence.

Title: Re: AVX2 is dimwitted compared to AVX512
Post by: mocore on February 27, 2024, 10:07:27 PM

hi rich

Quote from: Rich on February 25, 2024, 10:00:51 AM

to me it appeared the second machine was treating this as a linear problem
instead of an exponential one.

interesting to hear you perspective on this
...  it appears you where paying attention in math class and have reattained the numeric reflex's

of course  ;) *

Quote from: Rich on February 25, 2024, 10:00:51 AM

Of course it still could have been a subtle math error and the fact
that it answered 15 was just a coincidence.

... many potential methods to get to the correct answer , (presumably?) even more for less correct ones

which reminds me of count down
https://www.youtube.com/watch?v=Lbhxv5QPErM


much ( :o if not all lol ) of the details are likely way over my head also

...however  wrt the (*wonders* of modern hardware  ) hw 

https://en.wikipedia.org/wiki/Advanced_Vector_Extensions

Quote

Downclocking
Since AVX instructions are wider and generate more heat, some Intel processors have provisions to reduce the Turbo Boost frequency limit when such instructions are being executed.

???

https://en.wikipedia.org/wiki/Single_instruction,_multiple_data

https://en.wikipedia.org/wiki/Flynn's_taxonomy