Something interesting happened.
I compiled raylib in native RPI mode (no X11) it worked with just one package - rpi-vc-dev.tcz.
You will get a vchiq* error which you can fix by running: sudo chmod 777/dev/vchiq
The key is sticking to Legacy GL drivers and NOT forcing VGA or a certain HDMI mode.
Alternatively, I can load Xorg-3d package to enable DRM (no-X11) and then run the DRM mode of raylib.
On DRM, I get better FPS for full screen effects.
But on native RPI (I think it talks directly to the VC4) its able to do better FPS on lights.
Both non-X11 modes struggle with Bunnymark (~2000 for 60fps).
But, with X11 my Bunnymark scores are twice as high (4000 for 60 fps).
Why is the same hardware performing so differently?
SDL2 extension updated in case you decide to go that way.
Edit: You can play a video from the console with "SDL_VIDEODRIVER=kmsdrm ffplay video.mp4", so I presume using sdl2 directly would work.
Wow thanks. Been tinkering with raylib. SDL is my fallback.
I am trying out Raylib instead of SDL, seems raylib has a native DRM mode for raspberry pi for command line graphics.
Maybe you're already aware, but SDL2 has a "KMS/DRM" driver as well.
Yeah, I am trying to get it to work without DRM because my goal is to avoid long loading times for extensions. Xorg-3D will really add a good 10 seconds. My goal is ~5-6 seconds of boot time if I can by pass DRM.
Thanks for all the help folks!