WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: AVX2 is dimwitted compared to AVX512  (Read 3090 times)

Offline mocore

  • Hero Member
  • *****
  • Posts: 642
  • ~.~
AVX2 is dimwitted compared to AVX512
« on: February 25, 2024, 06:45:22 AM »

*puts ML hat on*  ::)

older gpu/hw fails to solve mathematical riddles ...

https://github.com/google/gemma.cpp/issues/23

Quote
On a $10,000 AMD Ryzen 7995WX (znver4 avx512) Gemma 7b instruct sfp is able to solve mathematical riddles.

 :P

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11630
Re: AVX2 is dimwitted compared to AVX512
« Reply #1 on: February 25, 2024, 10:00:51 AM »
Hi mocore
... older gpu/hw fails to solve mathematical riddles ...

https://github.com/google/gemma.cpp/issues/23 ...
I'll admit a lot of the stuff they were talking about was over my head, but
to me it appeared the second machine was treating this as a linear problem
instead of an exponential one.

Exponential (volume doubles each day):
Algae growth rate = StartQuantity * ( 2 ^ Days )
Days to fill reservoir = 30
Days to fill half reservoir = 29

Linear (volume increases by equal amount each day):
Algae growth rate = StartQuantity * Days
Days to fill reservoir = 30
Days to fill half reservoir = 15

Of course it still could have been a subtle math error and the fact
that it answered 15 was just a coincidence.

Offline mocore

  • Hero Member
  • *****
  • Posts: 642
  • ~.~
Re: AVX2 is dimwitted compared to AVX512
« Reply #2 on: February 27, 2024, 10:07:27 PM »
hi rich


to me it appeared the second machine was treating this as a linear problem
instead of an exponential one.


interesting to hear you perspective on this
...  it appears you where paying attention in math class and have reattained the numeric reflex's

of course  ;) *


Of course it still could have been a subtle math error and the fact
that it answered 15 was just a coincidence.


... many potential methods to get to the correct answer , (presumably?) even more for less correct ones

which reminds me of count down
https://www.youtube.com/watch?v=Lbhxv5QPErM


much ( :o if not all lol ) of the details are likely way over my head also

...however  wrt the (*wonders* of modern hardware  ) hw 

https://en.wikipedia.org/wiki/Advanced_Vector_Extensions
Quote
Downclocking
Since AVX instructions are wider and generate more heat, some Intel processors have provisions to reduce the Turbo Boost frequency limit when such instructions are being executed.
???

https://en.wikipedia.org/wiki/Single_instruction,_multiple_data

https://en.wikipedia.org/wiki/Flynn's_taxonomy