Thought might be helpful to add some notes here after a couple of months 
I turned this idea into a hackathon project.
Demo: https://speckle-gamify-hackathon.herokuapp.com/
Source code: GitHub - chloesun/speckle_hackathon: Content->Speckle->THREEjs web based game(Metaverse?!)