WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: AVX2 is dimwitted compared to AVX512  (Read 4450 times)

Offline mocore

  • Hero Member
  • *****
  • Posts: 720
  • ~.~
AVX2 is dimwitted compared to AVX512
« on: February 25, 2024, 06:45:22 AM »

*puts ML hat on*  ::)

older gpu/hw fails to solve mathematical riddles ...

https://github.com/google/gemma.cpp/issues/23

Quote
On a $10,000 AMD Ryzen 7995WX (znver4 avx512) Gemma 7b instruct sfp is able to solve mathematical riddles.

 :P

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 12187
Re: AVX2 is dimwitted compared to AVX512
« Reply #1 on: February 25, 2024, 10:00:51 AM »
Hi mocore
... older gpu/hw fails to solve mathematical riddles ...

https://github.com/google/gemma.cpp/issues/23 ...
I'll admit a lot of the stuff they were talking about was over my head, but
to me it appeared the second machine was treating this as a linear problem
instead of an exponential one.

Exponential (volume doubles each day):
Algae growth rate = StartQuantity * ( 2 ^ Days )
Days to fill reservoir = 30
Days to fill half reservoir = 29

Linear (volume increases by equal amount each day):
Algae growth rate = StartQuantity * Days
Days to fill reservoir = 30
Days to fill half reservoir = 15

Of course it still could have been a subtle math error and the fact
that it answered 15 was just a coincidence.

Offline mocore

  • Hero Member
  • *****
  • Posts: 720
  • ~.~
Re: AVX2 is dimwitted compared to AVX512
« Reply #2 on: February 27, 2024, 10:07:27 PM »
hi rich


to me it appeared the second machine was treating this as a linear problem
instead of an exponential one.


interesting to hear you perspective on this
...  it appears you where paying attention in math class and have reattained the numeric reflex's

of course  ;) *


Of course it still could have been a subtle math error and the fact
that it answered 15 was just a coincidence.


... many potential methods to get to the correct answer , (presumably?) even more for less correct ones

which reminds me of count down
https://www.youtube.com/watch?v=Lbhxv5QPErM


much ( :o if not all lol ) of the details are likely way over my head also

...however  wrt the (*wonders* of modern hardware  ) hw 

https://en.wikipedia.org/wiki/Advanced_Vector_Extensions
Quote
Downclocking
Since AVX instructions are wider and generate more heat, some Intel processors have provisions to reduce the Turbo Boost frequency limit when such instructions are being executed.
???

https://en.wikipedia.org/wiki/Single_instruction,_multiple_data

https://en.wikipedia.org/wiki/Flynn's_taxonomy

Offline mocore

  • Hero Member
  • *****
  • Posts: 720
  • ~.~
Re: AVX512 hw & reproducibility or lack thereof
« Reply #3 on: July 25, 2025, 03:54:02 AM »
fwiw
happened to read this https://lists.gnu.org/archive/html/help-guix/2025-06/msg00081.html
attempt to  "get the exact same result on both AVX512 and non-AVX512
computers without much of an overhead"


and find this
 https://github.com/twosigma/libvirtcpuid/ - libvirtcpuid provides transparent CPUID virtualization, all in userspace.
 strange workaround mentioned